-- Logs begin at Tue 2022-08-23 15:31:47 UTC, end at Tue 2022-08-23 16:36:47 UTC. -- Aug 23 16:09:07.060384 dv-osbrick-836056-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 16:09:07.070557 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 16:09:07 2022] *** Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: nodename: dv-osbrick-836056-3-ceph Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: machine: x86_64 Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: clock source: unix Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: pcre jit disabled Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: detected number of CPU cores: 4 Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: current working directory: / Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: detected binary path: /usr/bin/uwsgi-core Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: your processes number limit is 47680 Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: your memory page size is 4096 bytes Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: detected max file descriptor number: 2048 Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: lock engine: pthread robust mutexes Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: thunder lock: enabled Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 16:09:07.073759 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 16:09:07.115864 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: Python main interpreter initialized at 0x558ea698c9c0 Aug 23 16:09:07.115864 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: python threads support enabled Aug 23 16:09:07.115864 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: your server socket listen backlog is limited to 100 connections Aug 23 16:09:07.115864 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: your mercy for graceful operations on workers is 90 seconds Aug 23 16:09:07.116243 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 16:09:07.116243 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: *** Operational MODE: preforking *** Aug 23 16:09:07.116525 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: *** uWSGI is running in multiple interpreter mode *** Aug 23 16:09:07.116525 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: spawned uWSGI master process (pid: 88346) Aug 23 16:09:07.116740 dv-osbrick-836056-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 23 16:09:07.118844 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: spawned uWSGI worker 1 (pid: 88357, cores: 1) Aug 23 16:09:07.118844 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: spawned uWSGI worker 2 (pid: 88358, cores: 1) Aug 23 16:09:07.118844 dv-osbrick-836056-3-ceph devstack@keystone.service[88346]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 16:09:11.663617 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:09:11.663617 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: from cryptography.utils import int_from_bytes Aug 23 16:09:11.664459 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:09:11.664459 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: from cryptography.utils import int_from_bytes Aug 23 16:09:11.664879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:09:11.664879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: from cryptography.utils import int_from_bytes Aug 23 16:09:11.665490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:09:11.665490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: from cryptography.utils import int_from_bytes Aug 23 16:09:11.714762 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 16:09:11.714954 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 16:09:11.715087 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] command line args: [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 16:09:11.715385 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 16:09:11.715520 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ================================================================================ {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 16:09:11.715798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] admin_token = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.716079 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] config_dir = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.716186 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.716398 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] config_source = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.716529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] debug = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.716759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.717130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.717277 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.717523 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 16:09:11.717655 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.717727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 16:09:11.717792 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.717855 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] command line args: [] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 16:09:11.717975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.718194 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 16:09:11.718364 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_config_append = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.718475 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ================================================================================ {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 16:09:11.718572 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.718572 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_dir = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.718754 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] admin_token = **** {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.718856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_file = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.718953 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] config_dir = [] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.719051 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.719147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.719244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.719370 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] config_source = [] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.719370 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] debug = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.719513 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.719711 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.719821 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.719821 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.720046 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.720126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.720244 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.720323 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.720435 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.720508 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.720632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.720705 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.720815 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] list_limit = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.720815 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] log_config_append = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.720998 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.721082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.721200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.721274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] log_dir = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.721389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.721463 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] log_file = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.721521 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.721595 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.721701 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.721815 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.721945 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.722121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.722197 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.722404 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.722525 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.722613 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.722687 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] publish_errors = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.722826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.722909 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.723023 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.723115 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.723226 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.723308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.723493 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.723614 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.723701 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.723773 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.723905 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.723980 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] standard_threads = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.724165 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.724293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.724372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.724450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.724527 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.724676 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.724895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] use_journal = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.724992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] use_json = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.725135 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] use_stderr = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.725294 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.725429 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] use_syslog = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.725514 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] publish_errors = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.725592 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.725663 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.725785 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.725934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.726078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.726155 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.726301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.726440 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.726529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.726602 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.726756 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.726846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] standard_threads = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.726993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.727073 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.727242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.727329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.727400 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.727468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.727585 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] use_journal = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.727699 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.727787 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] use_json = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.727923 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] use_stderr = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.728009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.728085 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] use_syslog = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.728205 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.728309 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:09:11.728440 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.728578 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.728654 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.728818 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.728895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.729082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.729161 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.729323 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.729449 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.729579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.729666 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.729816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.729905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.730089 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.730171 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.730328 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.730414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.730563 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.730654 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.730801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.730881 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.731050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.731126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.731287 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.731435 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.731537 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.731618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.731770 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.731845 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.732003 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.732087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.732234 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.732311 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.732469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.732545 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.732718 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.732801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.732966 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.733042 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.733197 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.733272 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.733427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.733503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.733673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.733748 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.733921 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.734009 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.734204 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.734464 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.734729 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.734803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.735035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.735140 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.735272 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.735511 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.735591 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.735749 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.735943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.736023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.736198 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.736409 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.736485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.736646 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.736725 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.736883 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.736970 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.737133 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.737210 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.737363 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.737440 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.737599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.737753 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.737827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.737896 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.738143 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.738229 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.738300 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.738381 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.738546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.738621 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.738781 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.738857 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.739018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.739101 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.739254 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.739331 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.739489 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.739581 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.739720 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.739802 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.739951 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.740024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.740181 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.740265 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.740446 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.740529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.740680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.740753 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.740911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.740992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.741139 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.741227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.741374 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.741455 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.741621 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.741696 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.741850 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.741932 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.742108 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.742184 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.742345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.742423 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.742581 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.742668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.742818 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.742896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.743056 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.743134 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.743288 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.743370 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.743528 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.743604 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.743764 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.743838 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.743996 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.744070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.744229 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.744306 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.744465 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.744540 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.744701 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.744778 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.744930 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.745008 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.745165 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.745240 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.745401 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.745476 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.745635 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.745716 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.745868 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.745943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.746125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.746205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.746387 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.746470 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.746626 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.746701 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.746862 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.746936 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.747096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.747173 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.747334 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.747408 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.747570 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.747645 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.747804 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.747882 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.748081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.748166 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.748267 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.748350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.748496 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.748579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.748729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.748813 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.748964 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.749039 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.749184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.749256 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.749415 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.749491 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.749649 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.749724 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.749897 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.749983 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.750159 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.750236 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.750402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.750483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.750642 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.750726 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.750881 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.750958 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.751109 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.external = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.751190 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.751339 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.751530 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.751615 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.751687 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.751791 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.751883 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.752029 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.752115 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.password = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.752262 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.752338 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.token = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.752503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.752580 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.752736 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.752820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.752981 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.753063 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.753213 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.753298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.753458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.753535 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.753703 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.753788 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.753931 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.754028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.754193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] auth.external = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.754269 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.754426 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.754566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.754723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.754821 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.754958 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.755072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.755192 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] auth.password = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.755311 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.755425 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] auth.token = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.755555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.755665 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.755791 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.755902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.756110 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.756232 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.756369 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.756469 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.756610 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.756721 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.756867 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.756953 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.757154 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.757238 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.757402 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.757486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] credential.caching = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.757651 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.757728 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.757897 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.757973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.758170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.758248 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.758405 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.758482 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.758648 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.758725 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.758883 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.758958 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.759134 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.759211 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.759366 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.759444 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.759617 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.759694 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.759851 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.759929 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.760259 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.760513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.760589 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.760807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.760891 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.761068 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.761308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.761388 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.761555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.761740 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.761825 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.762052 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.762228 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] federation.caching = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.762306 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.762529 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.762608 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.762766 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.762890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.763011 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.763130 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.763249 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.763375 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.763496 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.763615 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.763747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.763947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.764066 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.764260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.764382 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.764500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.764642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.764770 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.764889 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.765016 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.765141 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.765260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.765379 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.765496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.caching = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.765633 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.765761 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.765880 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.766029 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.766151 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.766274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.766396 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.766527 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.766651 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.766773 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.766902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.767023 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.767144 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.767281 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.767405 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.767526 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.767654 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.767775 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.767897 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.768026 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.768148 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.768269 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.768390 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.768510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.768632 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.768759 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.768883 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.769015 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.769137 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.769258 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.769379 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.769507 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.769631 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.769771 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.769890 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.770103 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.770226 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.770354 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.770473 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.770592 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.770721 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.770839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.770958 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.771084 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.771203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.771322 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.771441 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.771558 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.771706 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.771837 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.771958 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.772080 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.772197 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.772316 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.772444 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.772572 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.772697 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.772816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.772935 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.773054 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.773172 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.773297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.773416 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.773534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.773654 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.773771 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.773889 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.774045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.774176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.774295 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.774414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.774532 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.774658 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.774776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.774894 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.775012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.775136 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.775254 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.775379 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.775498 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.775617 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.775744 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.775863 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.775981 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.776107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.776226 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.776345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.776462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.776581 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.776698 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.776827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.776827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.777050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.777167 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.777286 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.777414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.777540 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.777777 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.777777 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.778055 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.778184 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.778316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.778439 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.778562 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.778683 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.778804 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.779236 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.779364 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.779496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.779618 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.779618 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.779847 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.779965 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.780095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.780217 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.780338 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.780460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.780581 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.780702 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.780831 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.780831 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.781070 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.781188 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.781310 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.781439 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.781571 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.781690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.781813 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.781934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.782072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.782191 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.782318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.782318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.782556 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.782678 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.782810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.782932 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.783061 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.783180 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.783302 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.783424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.783542 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.783660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.783787 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.783906 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.784024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.784024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.784264 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.784382 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.784517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.784517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.784741 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.784859 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.784976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.785094 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.785219 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.785338 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.785456 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.785574 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.785693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.785810 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.785934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.786113 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.786234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.786355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] role.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.786477 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.786598 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] role.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.786731 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.786853 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.786974 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.787095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.787216 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.787216 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.787216 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] resource.caching = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.787605 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.787727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.787857 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.787857 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.788085 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.788280 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.788280 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.788511 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.788632 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.788824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.788956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.788956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.789185 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.789307 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.789428 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.789549 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.789688 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.789812 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.789934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.790070 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.790191 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.790191 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] role.caching = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.790424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.790544 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] role.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.790661 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.790780 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.790899 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.791018 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.791144 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.791275 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.791402 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.791522 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.791640 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.791760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.791887 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.792010 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.792128 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.792246 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.792364 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.792483 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.792609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.792729 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.792857 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.792977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.793095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.793214 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.793339 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.793459 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.793578 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.793697 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.793816 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.793934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.794116 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.794116 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.794350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.794482 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.794603 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.794725 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.794854 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.794977 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.795099 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.795220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.795340 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.795469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.795590 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.795713 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.795834 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.795957 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.796078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.796217 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.796339 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.796460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.796582 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.796706 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.796827 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.796956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.797077 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.797200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.797321 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.797442 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.797563 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.797693 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.797823 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.797945 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.798077 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.798197 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.798316 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.798447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.798570 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.798694 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.798815 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.798936 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.799063 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] token.caching = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.799192 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.799316 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.799438 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.connection = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.799576 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.799708 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.799830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.799951 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800075 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800232 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800376 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800597 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800667 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800737 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800807 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.800954 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801025 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801165 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801381 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801453 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801523 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801593 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801743 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801821 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801893 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.801965 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.802119 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.802119 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.802248 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.connection = **** {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.802334 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.802415 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.802494 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 16:09:11.802566 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.802566 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.802566 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.802566 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.802801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.803027 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.803253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.803501 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.803741 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.803988 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.804231 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.804483 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.804719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.804966 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.805198 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.805439 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.805675 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:09:11.805845 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 16:09:11.831298 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.831570 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.831841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.834752 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.834987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.835214 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.840525 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.844371 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.870125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.870411 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.872447 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.872687 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.923318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.924121 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.971874 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.972054 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.973881 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:11.974146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.038804 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.038985 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.039138 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.039384 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.039599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.039720 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.039799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.039877 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.040136 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.040357 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.040576 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.040791 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.062790 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.063023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.063143 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.063222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.063363 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.063466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.063597 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.063676 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.063821 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.063904 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.064030 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.064121 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.064249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.064495 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.075025 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.076036 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.087862 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.088002 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.088080 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.088143 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.088275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.088393 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.088593 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.088723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.088863 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.088986 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.089105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.089236 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.089370 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.089491 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:09:12.105728 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.105917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:09:12.106080 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.106161 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:09:12.106277 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.106510 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:09:12.106634 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.106711 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:09:12.106788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.106953 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.107044 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.107236 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.107358 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.107448 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.107513 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.107739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.116980 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.117230 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.117353 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.117556 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.117683 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.117820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.117942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.118091 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.124693 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.124974 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.127590 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.127871 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.127994 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.128202 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.128293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.128414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.128534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.128652 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.128770 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.128898 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.129070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.129194 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.129312 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.129436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.129569 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.129694 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.129818 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.129944 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.130092 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.130224 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.130349 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.130562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.156057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.156422 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.157524 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.157811 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.159191 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.159702 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.162453 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.162770 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.163053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.168314 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.168795 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.169087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.169510 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.169795 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.173899 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.174216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.174500 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.174782 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.175085 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.175471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.175593 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.175787 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.175909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.176043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.180144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.180443 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.180727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.181022 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.181312 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.181701 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.181984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.182280 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.191539 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.191817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.195810 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.197848 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.198156 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.198968 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.199262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.202035 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.203682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.205122 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.205422 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.206834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.209798 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.209982 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.210345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.210635 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.210918 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.211201 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.211580 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.212921 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.216126 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.216431 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.216720 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.217013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.217298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.217694 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.227313 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.227563 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.227866 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.228106 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.233495 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.233792 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.234098 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.234368 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.234848 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.236522 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.236796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.239460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.239753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.240044 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.240316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.240784 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.241129 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.242896 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.243104 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.245769 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.246090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.246374 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.246668 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.246959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.252033 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.252319 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.252603 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.252884 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.253171 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.253453 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.253731 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.258277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.258563 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.258843 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.259126 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.259419 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.259697 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.259973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.269265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.272222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.275260 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.275383 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.276702 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.278217 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.278360 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.278545 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.278764 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.281706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.283226 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.284760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.285046 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.285327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.285520 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.287008 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.289973 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.290208 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.290517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.290803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.291912 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.293398 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.296282 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.296575 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.296857 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.297135 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.299614 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.299906 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.300190 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.306030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.306340 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.306619 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.306960 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.307348 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.307631 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.307913 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.308196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.308473 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.308747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.309032 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.309301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.309574 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.309846 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.310134 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.310405 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.310667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.313321 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:09:12.313726 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.314018 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.314309 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.314589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.314867 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.315141 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.315419 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.315700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.315980 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.316250 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.316515 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.316788 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.317049 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:09:12.343773 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558ea698c9c0 pid: 88357 (default app) Aug 23 16:09:12.347273 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb2211-da5b-4916-bd10-601a9f2ccfb5 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:12.347560 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb2211-da5b-4916-bd10-601a9f2ccfb5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:12.347806 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb2211-da5b-4916-bd10-601a9f2ccfb5 None None] PATH_INFO: `/v3` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:12.349946 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558ea698c9c0 pid: 88358 (default app) Aug 23 16:09:12.352107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Tue Aug 23 16:09:12 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:19.392293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae5852-ccaf-4024-aeac-73a999b71ef5 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:19.393119 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae5852-ccaf-4024-aeac-73a999b71ef5 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:19.393119 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae5852-ccaf-4024-aeac-73a999b71ef5 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:19.398789 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:19 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:19.404827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73577169-4df1-4a29-9cd0-77fdefa86c98 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:19.405253 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73577169-4df1-4a29-9cd0-77fdefa86c98 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:19.405335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73577169-4df1-4a29-9cd0-77fdefa86c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:19.481581 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: INFO dbcounter [None req-73577169-4df1-4a29-9cd0-77fdefa86c98 None None] Registered counter for database keystone Aug 23 16:09:19.502777 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG oslo_db.sqlalchemy.engines [None req-73577169-4df1-4a29-9cd0-77fdefa86c98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:09:19.513431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writer thread running {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:09:19.699032 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG passlib.handlers.bcrypt [None req-73577169-4df1-4a29-9cd0-77fdefa86c98 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88357) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 16:09:19.699446 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG passlib.handlers.bcrypt [None req-73577169-4df1-4a29-9cd0-77fdefa86c98 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88357) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 16:09:19.754546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-73577169-4df1-4a29-9cd0-77fdefa86c98 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:19.756214 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-73577169-4df1-4a29-9cd0-77fdefa86c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:19.905445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 23 16:09:20.478897 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae5852-ccaf-4024-aeac-73a999b71ef5 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:20.565513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: INFO dbcounter [None req-12ae5852-ccaf-4024-aeac-73a999b71ef5 None None] Registered counter for database keystone Aug 23 16:09:20.590500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG oslo_db.sqlalchemy.engines [None req-12ae5852-ccaf-4024-aeac-73a999b71ef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:09:20.601410 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writer thread running {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:09:20.720104 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae5852-ccaf-4024-aeac-73a999b71ef5 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:20.725552 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f4c79-15fb-473f-aa0a-7b4bc6b81a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:20.726202 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f4c79-15fb-473f-aa0a-7b4bc6b81a38 admin admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:20.726477 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f4c79-15fb-473f-aa0a-7b4bc6b81a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:20.726746 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f4c79-15fb-473f-aa0a-7b4bc6b81a38 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:20.735465 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f4c79-15fb-473f-aa0a-7b4bc6b81a38 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:20.786743 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8d8f4c79-15fb-473f-aa0a-7b4bc6b81a38 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 16:09:20.787097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f4c79-15fb-473f-aa0a-7b4bc6b81a38 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:20.797827 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Tue Aug 23 16:09:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:09:20.805167 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73577169-4df1-4a29-9cd0-77fdefa86c98 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:20.830630 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73577169-4df1-4a29-9cd0-77fdefa86c98 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:20.835990 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afd250-ade5-4af8-8d75-4630fc75cf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:20.837097 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd250-ade5-4af8-8d75-4630fc75cf7f admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:20.837368 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd250-ade5-4af8-8d75-4630fc75cf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:20.837652 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd250-ade5-4af8-8d75-4630fc75cf7f admin admin] PATH_INFO: `/v3/projects/295f022ed51d4bed9be5939f17b6ff6c` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:20.839183 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afd250-ade5-4af8-8d75-4630fc75cf7f admin admin] RBAC: Authorizing `identity:get_project(project_id=295f022ed51d4bed9be5939f17b6ff6c)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:20.888422 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a4afd250-ade5-4af8-8d75-4630fc75cf7f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 16:09:20.888763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afd250-ade5-4af8-8d75-4630fc75cf7f admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:20.893419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Tue Aug 23 16:09:20 2022] GET /identity/v3/projects/295f022ed51d4bed9be5939f17b6ff6c => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:23.003818 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf1bfc-f2d8-447c-afb8-7e5d0dae19b0 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:23.004421 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf1bfc-f2d8-447c-afb8-7e5d0dae19b0 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:23.004421 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf1bfc-f2d8-447c-afb8-7e5d0dae19b0 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:23.008555 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:23.015388 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf2e5e-4586-4857-8b68-11a4b2ddd5f2 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:23.015840 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf2e5e-4586-4857-8b68-11a4b2ddd5f2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:23.015928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf2e5e-4586-4857-8b68-11a4b2ddd5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:23.039243 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-e7bf2e5e-4586-4857-8b68-11a4b2ddd5f2 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:23.040837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-e7bf2e5e-4586-4857-8b68-11a4b2ddd5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:23.053056 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 16:09:23.375808 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf1bfc-f2d8-447c-afb8-7e5d0dae19b0 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:23.390061 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf1bfc-f2d8-447c-afb8-7e5d0dae19b0 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:23.395994 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23378ec8-e1e1-4d84-9890-e586435b1cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:23.396913 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23378ec8-e1e1-4d84-9890-e586435b1cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:23.397275 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23378ec8-e1e1-4d84-9890-e586435b1cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:23.397629 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23378ec8-e1e1-4d84-9890-e586435b1cd3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:23.411912 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23378ec8-e1e1-4d84-9890-e586435b1cd3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:23.413710 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23378ec8-e1e1-4d84-9890-e586435b1cd3 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:23.423129 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Tue Aug 23 16:09:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 16:09:23.428670 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf2e5e-4586-4857-8b68-11a4b2ddd5f2 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:23.438295 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf2e5e-4586-4857-8b68-11a4b2ddd5f2 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:23.443173 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65472ea1-cb2e-4c42-9a12-ee98e4bac4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:23.443791 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65472ea1-cb2e-4c42-9a12-ee98e4bac4bf admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:23.444076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65472ea1-cb2e-4c42-9a12-ee98e4bac4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:23.444342 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65472ea1-cb2e-4c42-9a12-ee98e4bac4bf admin admin] PATH_INFO: `/v3/users/e029965b87334204be7b0f6baa7febea` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:23.445703 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65472ea1-cb2e-4c42-9a12-ee98e4bac4bf admin admin] RBAC: Authorizing `identity:get_user(user_id=e029965b87334204be7b0f6baa7febea)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:23.447574 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65472ea1-cb2e-4c42-9a12-ee98e4bac4bf admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:23.449095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Tue Aug 23 16:09:23 2022] GET /identity/v3/users/e029965b87334204be7b0f6baa7febea => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:25.680261 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea7c6c-7fc2-4d28-b50d-17868d064b8f None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:25.680811 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea7c6c-7fc2-4d28-b50d-17868d064b8f None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:25.680811 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea7c6c-7fc2-4d28-b50d-17868d064b8f None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:25.682338 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:25.687713 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c17c1d-62e4-4d1b-8e78-6e9552216bb2 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:25.688158 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c17c1d-62e4-4d1b-8e78-6e9552216bb2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:25.688250 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c17c1d-62e4-4d1b-8e78-6e9552216bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:25.697531 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b311a-4f18-4b9d-aea6-c45b82236bbe None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:25.697813 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b311a-4f18-4b9d-aea6-c45b82236bbe None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:25.698123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b311a-4f18-4b9d-aea6-c45b82236bbe None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:25.699434 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:25.704632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d512f-3372-40ef-81a8-d0d60c91784a None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:25.704913 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d512f-3372-40ef-81a8-d0d60c91784a None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:25.705183 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d512f-3372-40ef-81a8-d0d60c91784a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:25.707376 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a5c17c1d-62e4-4d1b-8e78-6e9552216bb2 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:25.708595 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a5c17c1d-62e4-4d1b-8e78-6e9552216bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:25.748683 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG passlib.handlers.bcrypt [None req-bc3d512f-3372-40ef-81a8-d0d60c91784a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88358) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 16:09:25.749054 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG passlib.handlers.bcrypt [None req-bc3d512f-3372-40ef-81a8-d0d60c91784a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88358) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 16:09:25.794953 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-bc3d512f-3372-40ef-81a8-d0d60c91784a None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:25.796610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-bc3d512f-3372-40ef-81a8-d0d60c91784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:25.905366 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:25.908180 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:09:26.221019 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c17c1d-62e4-4d1b-8e78-6e9552216bb2 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:26.222132 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d512f-3372-40ef-81a8-d0d60c91784a None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:26.248310 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:26.333175 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d512f-3372-40ef-81a8-d0d60c91784a None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:26.334452 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c17c1d-62e4-4d1b-8e78-6e9552216bb2 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:26.335604 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:26.370942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0633c1e-3f95-49e6-8d86-6757ceacd844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:26.371141 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f50589-b126-4f8b-bb88-0329c8a1b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:26.371578 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0633c1e-3f95-49e6-8d86-6757ceacd844 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:26.371863 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0633c1e-3f95-49e6-8d86-6757ceacd844 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:26.372001 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f50589-b126-4f8b-bb88-0329c8a1b596 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:26.372092 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0633c1e-3f95-49e6-8d86-6757ceacd844 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:26.372251 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f50589-b126-4f8b-bb88-0329c8a1b596 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:26.372509 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f50589-b126-4f8b-bb88-0329c8a1b596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:26.384099 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0633c1e-3f95-49e6-8d86-6757ceacd844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-d0633c1e-3f95-49e6-8d86-6757ceacd844 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:26.393040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:26.394041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:26.394914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:26.394914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:26.394914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:26.394914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:26.394914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:26.394914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:26.394914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:26.394914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:26.394914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:26.394914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:26.394914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:26.394914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:09:26.395857 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:09:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:26.399909 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0633c1e-3f95-49e6-8d86-6757ceacd844 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:26.440346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f50589-b126-4f8b-bb88-0329c8a1b596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:26.441878 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f50589-b126-4f8b-bb88-0329c8a1b596 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:26.480863 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:26.500586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0633c1e-3f95-49e6-8d86-6757ceacd844 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:26.539171 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed49c2-9edf-4eb9-8ab8-68d1fcdf0307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:26.539781 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed49c2-9edf-4eb9-8ab8-68d1fcdf0307 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:26.540051 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed49c2-9edf-4eb9-8ab8-68d1fcdf0307 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:26.540315 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed49c2-9edf-4eb9-8ab8-68d1fcdf0307 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:26.540968 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed49c2-9edf-4eb9-8ab8-68d1fcdf0307 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:26.541276 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed49c2-9edf-4eb9-8ab8-68d1fcdf0307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:26.542698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed49c2-9edf-4eb9-8ab8-68d1fcdf0307 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:26.545252 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 8/15] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:09:26.550835 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f50589-b126-4f8b-bb88-0329c8a1b596 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:26.553551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:26.554936 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 8/16] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:26.560792 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed49c2-9edf-4eb9-8ab8-68d1fcdf0307 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:26.646703 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f50589-b126-4f8b-bb88-0329c8a1b596 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:26.658339 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed49c2-9edf-4eb9-8ab8-68d1fcdf0307 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:26.680044 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0de42d-06f3-4330-9ec2-07e80c83ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:26.680881 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0de42d-06f3-4330-9ec2-07e80c83ac93 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:26.681444 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0de42d-06f3-4330-9ec2-07e80c83ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:26.681444 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0de42d-06f3-4330-9ec2-07e80c83ac93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:26.694825 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f4d05-8d2b-4c7a-bc62-624505e5fd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:26.695470 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f4d05-8d2b-4c7a-bc62-624505e5fd85 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:26.695724 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f4d05-8d2b-4c7a-bc62-624505e5fd85 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:26.695987 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f4d05-8d2b-4c7a-bc62-624505e5fd85 None admin] PATH_INFO: `/v3/users/e029965b87334204be7b0f6baa7febea` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:26.697156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f4d05-8d2b-4c7a-bc62-624505e5fd85 None admin] RBAC: Authorizing `identity:get_user(user_id=e029965b87334204be7b0f6baa7febea)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:26.698677 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f4d05-8d2b-4c7a-bc62-624505e5fd85 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:26.699776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0de42d-06f3-4330-9ec2-07e80c83ac93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:26.700527 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:26 2022] GET /identity/v3/users/e029965b87334204be7b0f6baa7febea => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:26.701356 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0de42d-06f3-4330-9ec2-07e80c83ac93 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:26.705891 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f4d05-8d2b-4c7a-bc62-624505e5fd85 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:26.720443 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-4f0de42d-06f3-4330-9ec2-07e80c83ac93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:09:26.721296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:26.723028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:09:26.724138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:09:26.724138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:09:26.724138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:26.724138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 9/18] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:09:26.730495 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0de42d-06f3-4330-9ec2-07e80c83ac93 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:26.818738 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f4d05-8d2b-4c7a-bc62-624505e5fd85 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:26.856982 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bd75c-4f2a-48fd-a7d6-b3b545ecd9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:26.857642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bd75c-4f2a-48fd-a7d6-b3b545ecd9e6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:26.857919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bd75c-4f2a-48fd-a7d6-b3b545ecd9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:26.858219 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bd75c-4f2a-48fd-a7d6-b3b545ecd9e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:26.859372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bd75c-4f2a-48fd-a7d6-b3b545ecd9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:26.860831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bd75c-4f2a-48fd-a7d6-b3b545ecd9e6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:26.862419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 10/19] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:09:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:26.868439 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bd75c-4f2a-48fd-a7d6-b3b545ecd9e6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:26.902630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:26.947114 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0de42d-06f3-4330-9ec2-07e80c83ac93 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:26.950320 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:26.969874 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bd75c-4f2a-48fd-a7d6-b3b545ecd9e6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:26.980329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a397e7f-4c3f-431c-a3ff-b590f062d230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:26.980947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397e7f-4c3f-431c-a3ff-b590f062d230 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:26.981220 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397e7f-4c3f-431c-a3ff-b590f062d230 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:26.981497 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397e7f-4c3f-431c-a3ff-b590f062d230 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:26.982168 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a397e7f-4c3f-431c-a3ff-b590f062d230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:26.982471 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a397e7f-4c3f-431c-a3ff-b590f062d230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:26.983879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a397e7f-4c3f-431c-a3ff-b590f062d230 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:27.001418 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 10/20] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:27.004042 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad0f8f-9d0e-4ac3-97cb-bafbfe3af79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:27.004657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad0f8f-9d0e-4ac3-97cb-bafbfe3af79b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:27.004934 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad0f8f-9d0e-4ac3-97cb-bafbfe3af79b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:27.005261 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad0f8f-9d0e-4ac3-97cb-bafbfe3af79b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:27.005990 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad0f8f-9d0e-4ac3-97cb-bafbfe3af79b None admin] RBAC: Adding query filter params (role.id=5756384fa8d842139e2f1fc44c5088bd, scope.domain.id=default, user.id=e029965b87334204be7b0f6baa7febea) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:27.006346 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad0f8f-9d0e-4ac3-97cb-bafbfe3af79b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:27.007825 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad0f8f-9d0e-4ac3-97cb-bafbfe3af79b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:27.016003 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 11/21] 10.222.0.47 () {56 vars in 1322 bytes} [Tue Aug 23 16:09:26 2022] GET /identity/v3/role_assignments?user.id=e029965b87334204be7b0f6baa7febea&scope.domain.id=default&role.id=5756384fa8d842139e2f1fc44c5088bd => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:29.394647 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3076ff-dac5-4a65-bf24-96d39364713f None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:29.395757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3076ff-dac5-4a65-bf24-96d39364713f None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:29.396237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3076ff-dac5-4a65-bf24-96d39364713f None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:29.397778 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 11/22] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:29.403035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969bdc1-3273-4d4a-b61b-0f8f7777ba07 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:29.404198 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969bdc1-3273-4d4a-b61b-0f8f7777ba07 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:29.404686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969bdc1-3273-4d4a-b61b-0f8f7777ba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:29.431071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-9969bdc1-3273-4d4a-b61b-0f8f7777ba07 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:29.432650 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-9969bdc1-3273-4d4a-b61b-0f8f7777ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:29.515250 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 12/23] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:29.612638 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f7cf3-b18a-4970-bbe4-c89737353996 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:29.613256 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f7cf3-b18a-4970-bbe4-c89737353996 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:29.613725 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f7cf3-b18a-4970-bbe4-c89737353996 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:29.615551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 12/24] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:29.621319 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f52a40-f1a4-410a-9179-5f21b882aaa6 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:29.621936 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f52a40-f1a4-410a-9179-5f21b882aaa6 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:29.622434 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f52a40-f1a4-410a-9179-5f21b882aaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:29.651165 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-45f52a40-f1a4-410a-9179-5f21b882aaa6 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:29.652724 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-45f52a40-f1a4-410a-9179-5f21b882aaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:29.743927 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 13/25] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:29.978589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f7cf3-b18a-4970-bbe4-c89737353996 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:30.056393 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a17ddd-4aa7-4966-9259-02f8559b7175 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:30.056729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a17ddd-4aa7-4966-9259-02f8559b7175 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:30.056948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a17ddd-4aa7-4966-9259-02f8559b7175 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:30.058383 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 14/26] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:09:30.067083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3847ac-169b-418e-8bf6-408904dc8e7d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:30.067365 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3847ac-169b-418e-8bf6-408904dc8e7d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:30.067673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3847ac-169b-418e-8bf6-408904dc8e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:30.081845 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:30.096631 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-9c3847ac-169b-418e-8bf6-408904dc8e7d None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:30.097843 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-9c3847ac-169b-418e-8bf6-408904dc8e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:30.146673 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f7cf3-b18a-4970-bbe4-c89737353996 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:30.183025 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:30.216302 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef33804-1d07-4855-bdd1-f98be999b408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:30.216941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef33804-1d07-4855-bdd1-f98be999b408 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:30.217213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef33804-1d07-4855-bdd1-f98be999b408 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:30.217487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef33804-1d07-4855-bdd1-f98be999b408 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:30.242899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef33804-1d07-4855-bdd1-f98be999b408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:30.244563 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 15/27] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-fef33804-1d07-4855-bdd1-f98be999b408 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:30.250074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:30.250902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:30.252011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 13/28] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:09:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:30.259375 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3847ac-169b-418e-8bf6-408904dc8e7d None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:30.399864 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef33804-1d07-4855-bdd1-f98be999b408 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:30.415933 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3847ac-169b-418e-8bf6-408904dc8e7d None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:30.481118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633edac5-1f4c-4c11-be1e-47d503ef256d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:30.481779 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633edac5-1f4c-4c11-be1e-47d503ef256d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:30.482097 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633edac5-1f4c-4c11-be1e-47d503ef256d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:30.482372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633edac5-1f4c-4c11-be1e-47d503ef256d None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:30.484140 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633edac5-1f4c-4c11-be1e-47d503ef256d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:30.484452 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633edac5-1f4c-4c11-be1e-47d503ef256d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:30.485870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633edac5-1f4c-4c11-be1e-47d503ef256d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:30.487604 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:30.506444 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 16/29] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:09:30.514907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633edac5-1f4c-4c11-be1e-47d503ef256d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:30.575424 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef33804-1d07-4855-bdd1-f98be999b408 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:30.631682 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5643b-cf54-4e89-93b8-e636714e90e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:30.632332 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5643b-cf54-4e89-93b8-e636714e90e7 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:30.632666 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5643b-cf54-4e89-93b8-e636714e90e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:30.632941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5643b-cf54-4e89-93b8-e636714e90e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:30.648860 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5643b-cf54-4e89-93b8-e636714e90e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:30.650398 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5643b-cf54-4e89-93b8-e636714e90e7 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-acb5643b-cf54-4e89-93b8-e636714e90e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:09:30.683693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:30.684625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:09:30.685409 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:09:30.685409 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:09:30.685409 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:30.687244 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 14/30] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:30.693703 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec0ad9-021c-43bc-ae84-67cb9b4d1612 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:30.694199 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec0ad9-021c-43bc-ae84-67cb9b4d1612 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:30.694601 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec0ad9-021c-43bc-ae84-67cb9b4d1612 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:30.696043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 15/31] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:09:30.696923 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec0ad9-021c-43bc-ae84-67cb9b4d1612 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:30.732473 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:30.800692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633edac5-1f4c-4c11-be1e-47d503ef256d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:30.833987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec0ad9-021c-43bc-ae84-67cb9b4d1612 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:30.840717 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c69676-6c72-439e-9c0e-99afc64df20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:30.841428 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c69676-6c72-439e-9c0e-99afc64df20d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:30.841769 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c69676-6c72-439e-9c0e-99afc64df20d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:30.842172 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c69676-6c72-439e-9c0e-99afc64df20d None admin] PATH_INFO: `/v3/users/e029965b87334204be7b0f6baa7febea` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:30.843496 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c69676-6c72-439e-9c0e-99afc64df20d None admin] RBAC: Authorizing `identity:get_user(user_id=e029965b87334204be7b0f6baa7febea)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:30.845092 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c69676-6c72-439e-9c0e-99afc64df20d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:30.847327 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 17/32] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:30 2022] GET /identity/v3/users/e029965b87334204be7b0f6baa7febea => generated 247 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:30.848491 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0948d64-ba0d-4cb6-ae58-cb800376b2f2 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:30.853297 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0948d64-ba0d-4cb6-ae58-cb800376b2f2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:30.853745 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0948d64-ba0d-4cb6-ae58-cb800376b2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:30.871752 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-d0948d64-ba0d-4cb6-ae58-cb800376b2f2 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:30.873234 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-d0948d64-ba0d-4cb6-ae58-cb800376b2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:30.874255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8f311-cf34-4a1e-83e1-9675f430401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:30.874946 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8f311-cf34-4a1e-83e1-9675f430401f None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:30.875293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8f311-cf34-4a1e-83e1-9675f430401f None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:30.875635 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8f311-cf34-4a1e-83e1-9675f430401f None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:30.876521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8f311-cf34-4a1e-83e1-9675f430401f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:30.876891 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8f311-cf34-4a1e-83e1-9675f430401f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:30.879240 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8f311-cf34-4a1e-83e1-9675f430401f None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:30.894500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 16/33] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:30.898621 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8f311-cf34-4a1e-83e1-9675f430401f None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:30.939100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:30.954084 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 18/34] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:30.955263 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0948d64-ba0d-4cb6-ae58-cb800376b2f2 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:31.010046 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:31.028772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8f311-cf34-4a1e-83e1-9675f430401f None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:31.074106 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92324b2-ad85-4e51-9b03-1f343992bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:31.074106 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92324b2-ad85-4e51-9b03-1f343992bf73 None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:31.074106 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92324b2-ad85-4e51-9b03-1f343992bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:31.074106 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92324b2-ad85-4e51-9b03-1f343992bf73 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:31.074479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92324b2-ad85-4e51-9b03-1f343992bf73 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:31.074479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92324b2-ad85-4e51-9b03-1f343992bf73 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:31.196824 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0948d64-ba0d-4cb6-ae58-cb800376b2f2 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:31.231217 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 17/35] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Aug 23 16:09:30 2022] POST /identity/v3/roles => generated 219 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:09:31.231878 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f980462-d23c-472a-873b-465a95b7933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:31.232516 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f980462-d23c-472a-873b-465a95b7933f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:31.232797 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f980462-d23c-472a-873b-465a95b7933f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:31.233070 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f980462-d23c-472a-873b-465a95b7933f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:31.234254 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f980462-d23c-472a-873b-465a95b7933f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:31.235143 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92324b2-ad85-4e51-9b03-1f343992bf73 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:31.235752 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f980462-d23c-472a-873b-465a95b7933f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:31.237463 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 19/36] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:09:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:31.238782 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c05bd-f2cb-472d-9dc3-13a00f909145 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:31.239066 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c05bd-f2cb-472d-9dc3-13a00f909145 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:31.239370 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c05bd-f2cb-472d-9dc3-13a00f909145 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:31.246051 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 20/37] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:31.246051 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae75d-5c6b-4202-846a-ec8c36e2a12e None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:31.246051 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae75d-5c6b-4202-846a-ec8c36e2a12e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:31.246051 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae75d-5c6b-4202-846a-ec8c36e2a12e None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:31.246051 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 21/38] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:31.246051 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ae75d-5c6b-4202-846a-ec8c36e2a12e None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:31.324072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:31.367729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ae75d-5c6b-4202-846a-ec8c36e2a12e None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:31.375211 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92324b2-ad85-4e51-9b03-1f343992bf73 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:31.407437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f362073-0fa6-4400-8839-4e538acac7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:31.408153 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f362073-0fa6-4400-8839-4e538acac7a4 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:31.408451 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f362073-0fa6-4400-8839-4e538acac7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:31.408786 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f362073-0fa6-4400-8839-4e538acac7a4 None admin] PATH_INFO: `/v3/domains/default/users/e029965b87334204be7b0f6baa7febea/roles/5756384fa8d842139e2f1fc44c5088bd` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:31.410881 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f362073-0fa6-4400-8839-4e538acac7a4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e029965b87334204be7b0f6baa7febea, role_id=5756384fa8d842139e2f1fc44c5088bd)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:31.412413 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f362073-0fa6-4400-8839-4e538acac7a4 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:31.414559 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ae2a0-45bd-4515-8e67-8a45f0b1e259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:31.415308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ae2a0-45bd-4515-8e67-8a45f0b1e259 None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:31.415598 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ae2a0-45bd-4515-8e67-8a45f0b1e259 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:31.415875 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ae2a0-45bd-4515-8e67-8a45f0b1e259 None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:31.416804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ae2a0-45bd-4515-8e67-8a45f0b1e259 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:31.419364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ae2a0-45bd-4515-8e67-8a45f0b1e259 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:31.446816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:31.453088 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 18/39] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 23 16:09:31 2022] POST /identity/v3/projects => generated 301 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:09:31.456478 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b1baf-2207-4da6-b28f-986f690d48bf None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:31.456478 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b1baf-2207-4da6-b28f-986f690d48bf None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:31.456478 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b1baf-2207-4da6-b28f-986f690d48bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:31.478803 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-d26b1baf-2207-4da6-b28f-986f690d48bf None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:31.480407 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-d26b1baf-2207-4da6-b28f-986f690d48bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:31.546147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 22/40] 10.222.0.47 () {58 vars in 1361 bytes} [Tue Aug 23 16:09:31 2022] PUT /identity/v3/domains/default/users/e029965b87334204be7b0f6baa7febea/roles/5756384fa8d842139e2f1fc44c5088bd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:09:31.547805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9b017-e68d-47bd-b028-b8c23998fdab None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:31.548101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9b017-e68d-47bd-b028-b8c23998fdab None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:31.548374 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9b017-e68d-47bd-b028-b8c23998fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:31.569007 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-12f9b017-e68d-47bd-b028-b8c23998fdab None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:31.570669 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-12f9b017-e68d-47bd-b028-b8c23998fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:31.585590 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 19/41] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:31.586882 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b1baf-2207-4da6-b28f-986f690d48bf None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:31.689101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 23/42] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:31.719125 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b1baf-2207-4da6-b28f-986f690d48bf None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:31.750289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:31.757319 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5454339-c3b8-4d28-8fb6-1a05ddaf62fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:31.758431 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5454339-c3b8-4d28-8fb6-1a05ddaf62fb None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:31.758748 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5454339-c3b8-4d28-8fb6-1a05ddaf62fb None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:31.759019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5454339-c3b8-4d28-8fb6-1a05ddaf62fb None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:31.759683 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5454339-c3b8-4d28-8fb6-1a05ddaf62fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:31.761085 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5454339-c3b8-4d28-8fb6-1a05ddaf62fb None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:31.778991 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 20/43] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Aug 23 16:09:31 2022] POST /identity/v3/roles => generated 225 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:09:31.958911 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9b017-e68d-47bd-b028-b8c23998fdab None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:32.020739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:32.036977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5454339-c3b8-4d28-8fb6-1a05ddaf62fb None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:32.084926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9b017-e68d-47bd-b028-b8c23998fdab None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:32.124259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebbb0d-989c-4671-ad92-9a4237dc486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:32.124920 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebbb0d-989c-4671-ad92-9a4237dc486c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:32.125199 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebbb0d-989c-4671-ad92-9a4237dc486c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:32.125468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebbb0d-989c-4671-ad92-9a4237dc486c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:32.126678 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebbb0d-989c-4671-ad92-9a4237dc486c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:32.128380 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebbb0d-989c-4671-ad92-9a4237dc486c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:32.132700 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 24/44] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:09:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:32.138752 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebbb0d-989c-4671-ad92-9a4237dc486c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:32.153934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5454339-c3b8-4d28-8fb6-1a05ddaf62fb None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:32.188763 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7f40a-5252-4eb8-aa54-f2311a3bb464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:32.189432 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f40a-5252-4eb8-aa54-f2311a3bb464 None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:32.189713 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f40a-5252-4eb8-aa54-f2311a3bb464 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:32.190478 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f40a-5252-4eb8-aa54-f2311a3bb464 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:32.191142 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7f40a-5252-4eb8-aa54-f2311a3bb464 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:32.193403 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7f40a-5252-4eb8-aa54-f2311a3bb464 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:32.210142 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 21/45] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Aug 23 16:09:32 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:09:32.255326 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebbb0d-989c-4671-ad92-9a4237dc486c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:32.279578 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:32.297798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f8c71-f2d4-4f27-828f-1b862e66c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:32.298493 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f8c71-f2d4-4f27-828f-1b862e66c436 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:32.298776 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f8c71-f2d4-4f27-828f-1b862e66c436 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:32.299049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f8c71-f2d4-4f27-828f-1b862e66c436 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:32.299714 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f8c71-f2d4-4f27-828f-1b862e66c436 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:32.301264 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f8c71-f2d4-4f27-828f-1b862e66c436 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:32.336227 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 25/46] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 23 16:09:32 2022] POST /identity/v3/projects => generated 312 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:09:33.871766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcec911-2fc1-4837-a548-36e72a56f009 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:33.872301 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcec911-2fc1-4837-a548-36e72a56f009 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:33.872301 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcec911-2fc1-4837-a548-36e72a56f009 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:33.873707 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 22/47] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:33.879075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1b15a-b435-4968-8ad5-4eb3d99bb018 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:33.879508 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1b15a-b435-4968-8ad5-4eb3d99bb018 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:33.879773 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1b15a-b435-4968-8ad5-4eb3d99bb018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:33.899308 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-65a1b15a-b435-4968-8ad5-4eb3d99bb018 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:33.900528 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-65a1b15a-b435-4968-8ad5-4eb3d99bb018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:33.972444 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 26/48] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:34.289856 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcec911-2fc1-4837-a548-36e72a56f009 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:34.349650 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:34.405564 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcec911-2fc1-4837-a548-36e72a56f009 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:34.439895 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6022c1-3791-4c0d-affa-fecffcac83a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:34.440528 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6022c1-3791-4c0d-affa-fecffcac83a3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:34.440804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6022c1-3791-4c0d-affa-fecffcac83a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:34.441073 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6022c1-3791-4c0d-affa-fecffcac83a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:34.451804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6022c1-3791-4c0d-affa-fecffcac83a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-7c6022c1-3791-4c0d-affa-fecffcac83a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:34.457093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:34.458223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:34.459253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 23/49] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:09:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:34.464207 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1b15a-b435-4968-8ad5-4eb3d99bb018 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:34.492463 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58dcee-9d5d-4c67-a001-9fe59e44f4fa None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:34.492748 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58dcee-9d5d-4c67-a001-9fe59e44f4fa None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:34.493050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58dcee-9d5d-4c67-a001-9fe59e44f4fa None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:34.494603 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 24/50] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:09:34.499833 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1e748-c021-4ad7-b046-27da55c4cda2 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:34.500113 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1e748-c021-4ad7-b046-27da55c4cda2 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:34.500382 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1e748-c021-4ad7-b046-27da55c4cda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:34.518873 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-2ff1e748-c021-4ad7-b046-27da55c4cda2 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:34.520060 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-2ff1e748-c021-4ad7-b046-27da55c4cda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:34.568195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1b15a-b435-4968-8ad5-4eb3d99bb018 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:34.569629 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:34.587861 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 25/51] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:09:34.603463 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58258bba-227c-4f1e-bf27-4865952a8707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:34.604078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258bba-227c-4f1e-bf27-4865952a8707 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:34.604353 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258bba-227c-4f1e-bf27-4865952a8707 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:34.604618 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258bba-227c-4f1e-bf27-4865952a8707 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:34.605284 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58258bba-227c-4f1e-bf27-4865952a8707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:34.605580 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58258bba-227c-4f1e-bf27-4865952a8707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:34.607020 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58258bba-227c-4f1e-bf27-4865952a8707 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:34.614985 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 27/52] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:34.620734 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1e748-c021-4ad7-b046-27da55c4cda2 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:34.661270 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:34.718074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1e748-c021-4ad7-b046-27da55c4cda2 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:34.752872 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b61302-ad98-4891-b92c-4e84c7294163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:34.753518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b61302-ad98-4891-b92c-4e84c7294163 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:34.753801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b61302-ad98-4891-b92c-4e84c7294163 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:34.754110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b61302-ad98-4891-b92c-4e84c7294163 None admin] PATH_INFO: `/v3/users/e029965b87334204be7b0f6baa7febea` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:34.755561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b61302-ad98-4891-b92c-4e84c7294163 None admin] RBAC: Authorizing `identity:get_user(user_id=e029965b87334204be7b0f6baa7febea)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:34.757002 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b61302-ad98-4891-b92c-4e84c7294163 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:34.758631 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:34 2022] GET /identity/v3/users/e029965b87334204be7b0f6baa7febea => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:09:34.764126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58258bba-227c-4f1e-bf27-4865952a8707 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:34.861780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58258bba-227c-4f1e-bf27-4865952a8707 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:34.895738 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899cf7b-9219-48e4-9a44-4b7d59740777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:34.896329 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899cf7b-9219-48e4-9a44-4b7d59740777 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:34.896637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899cf7b-9219-48e4-9a44-4b7d59740777 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:34.896868 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899cf7b-9219-48e4-9a44-4b7d59740777 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:34.898048 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899cf7b-9219-48e4-9a44-4b7d59740777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:34.899486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899cf7b-9219-48e4-9a44-4b7d59740777 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:34.901310 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 28/54] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:09:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:34.907325 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b61302-ad98-4891-b92c-4e84c7294163 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:34.907830 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899cf7b-9219-48e4-9a44-4b7d59740777 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:34.938692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:35.006687 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899cf7b-9219-48e4-9a44-4b7d59740777 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:35.010468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b61302-ad98-4891-b92c-4e84c7294163 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:35.019503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:35.041350 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b5987-093a-48db-9fc5-89a2be85e5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:35.041980 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5987-093a-48db-9fc5-89a2be85e5f7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:35.042288 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5987-093a-48db-9fc5-89a2be85e5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:35.042565 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5987-093a-48db-9fc5-89a2be85e5f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:35.043717 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b5987-093a-48db-9fc5-89a2be85e5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:35.044464 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808afaec-da7e-4725-8db3-b70d10559f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:35.045065 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808afaec-da7e-4725-8db3-b70d10559f60 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:35.045154 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b5987-093a-48db-9fc5-89a2be85e5f7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:35.045338 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808afaec-da7e-4725-8db3-b70d10559f60 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:35.045603 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808afaec-da7e-4725-8db3-b70d10559f60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:35.046349 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808afaec-da7e-4725-8db3-b70d10559f60 None admin] RBAC: Adding query filter params (role.id=5756384fa8d842139e2f1fc44c5088bd, scope.domain.id=default, user.id=e029965b87334204be7b0f6baa7febea) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:35.046651 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808afaec-da7e-4725-8db3-b70d10559f60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:35.046733 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 29/55] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:09:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:35.048117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808afaec-da7e-4725-8db3-b70d10559f60 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:35.052435 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b5987-093a-48db-9fc5-89a2be85e5f7 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:35.057267 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 27/56] 10.222.0.47 () {56 vars in 1322 bytes} [Tue Aug 23 16:09:34 2022] GET /identity/v3/role_assignments?user.id=e029965b87334204be7b0f6baa7febea&scope.domain.id=default&role.id=5756384fa8d842139e2f1fc44c5088bd => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:35.154152 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:35.158166 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b5987-093a-48db-9fc5-89a2be85e5f7 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:35.195312 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb336e1-0619-4545-b1b9-8a76b37a64a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:35.195925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb336e1-0619-4545-b1b9-8a76b37a64a4 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:35.196209 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb336e1-0619-4545-b1b9-8a76b37a64a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:35.196441 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb336e1-0619-4545-b1b9-8a76b37a64a4 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:35.197133 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb336e1-0619-4545-b1b9-8a76b37a64a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:35.198663 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb336e1-0619-4545-b1b9-8a76b37a64a4 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:35.229172 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 30/57] 10.222.0.47 () {60 vars in 1140 bytes} [Tue Aug 23 16:09:35 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:09:37.433208 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d05d25-8440-4174-88db-7e782f6816fc None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:37.434087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d05d25-8440-4174-88db-7e782f6816fc None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:37.434087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d05d25-8440-4174-88db-7e782f6816fc None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:37.436234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 28/58] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:37.442767 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d38f-24ad-45e3-a976-01bbc815b62a None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:37.443507 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d38f-24ad-45e3-a976-01bbc815b62a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:37.443645 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d38f-24ad-45e3-a976-01bbc815b62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:37.467507 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-6ed4d38f-24ad-45e3-a976-01bbc815b62a None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:37.468710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-6ed4d38f-24ad-45e3-a976-01bbc815b62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:37.542338 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 31/59] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:37.869231 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d05d25-8440-4174-88db-7e782f6816fc None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:37.981545 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d05d25-8440-4174-88db-7e782f6816fc None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:38.016645 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab521004-d1f6-496d-b8a4-e238f0367b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:38.017307 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab521004-d1f6-496d-b8a4-e238f0367b9c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:38.017582 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab521004-d1f6-496d-b8a4-e238f0367b9c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:38.017859 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab521004-d1f6-496d-b8a4-e238f0367b9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:38.019109 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab521004-d1f6-496d-b8a4-e238f0367b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:38.020678 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab521004-d1f6-496d-b8a4-e238f0367b9c None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:38.022277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 29/60] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:09:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:38.031652 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4d38f-24ad-45e3-a976-01bbc815b62a None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:38.121614 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:38.142194 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4d38f-24ad-45e3-a976-01bbc815b62a None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:38.177606 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16020fd1-0cc0-41a5-8b98-8be17e707086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:38.178231 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16020fd1-0cc0-41a5-8b98-8be17e707086 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:38.178510 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16020fd1-0cc0-41a5-8b98-8be17e707086 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:38.178782 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16020fd1-0cc0-41a5-8b98-8be17e707086 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:38.179418 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16020fd1-0cc0-41a5-8b98-8be17e707086 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:38.180883 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16020fd1-0cc0-41a5-8b98-8be17e707086 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:38.212822 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 32/61] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 23 16:09:38 2022] POST /identity/v3/users => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:09:41.457181 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfc551-7109-463b-b1d2-32b0adadc441 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:41.458090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfc551-7109-463b-b1d2-32b0adadc441 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:41.458509 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfc551-7109-463b-b1d2-32b0adadc441 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:41.460025 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 30/62] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:41.465577 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c990cf0-4348-47ab-adf3-4e5d3e5c2ec2 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:41.466364 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c990cf0-4348-47ab-adf3-4e5d3e5c2ec2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:41.466779 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c990cf0-4348-47ab-adf3-4e5d3e5c2ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:41.495089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-8c990cf0-4348-47ab-adf3-4e5d3e5c2ec2 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:41.496589 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-8c990cf0-4348-47ab-adf3-4e5d3e5c2ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:41.570727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7e664-299b-4d00-8bd8-a49b2e2678f7 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:41.571066 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7e664-299b-4d00-8bd8-a49b2e2678f7 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:41.571277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7e664-299b-4d00-8bd8-a49b2e2678f7 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:41.572777 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:09:41.577696 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6931-df7b-4e5e-a453-5dc216114789 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:41.578085 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6931-df7b-4e5e-a453-5dc216114789 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:41.578369 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6931-df7b-4e5e-a453-5dc216114789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:41.592635 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 33/64] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:41.615105 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-549d6931-df7b-4e5e-a453-5dc216114789 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:41.616345 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-549d6931-df7b-4e5e-a453-5dc216114789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:41.679479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:41.727792 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 32/65] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:41.939079 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3ce41-1830-4ac8-aab1-b3cc3922884e None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:41.939789 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3ce41-1830-4ac8-aab1-b3cc3922884e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:41.940257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3ce41-1830-4ac8-aab1-b3cc3922884e None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:41.941828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 34/66] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:41.947298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f84f33-bd66-4738-992b-39f186eb0237 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:41.947798 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f84f33-bd66-4738-992b-39f186eb0237 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:41.948251 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f84f33-bd66-4738-992b-39f186eb0237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:41.974553 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-f6f84f33-bd66-4738-992b-39f186eb0237 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:41.976077 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-f6f84f33-bd66-4738-992b-39f186eb0237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:42.021776 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3ce41-1830-4ac8-aab1-b3cc3922884e None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:42.049645 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 33/67] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:09:42.114507 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:42.131835 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a500f-37eb-4312-88b0-440760fd1c6f None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.132452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a500f-37eb-4312-88b0-440760fd1c6f None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.132918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a500f-37eb-4312-88b0-440760fd1c6f None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:42.134530 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 34/68] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:09:42.142941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1b333-31bc-44ca-a6a5-0ffd59d43ac8 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.143549 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1b333-31bc-44ca-a6a5-0ffd59d43ac8 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.144033 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1b333-31bc-44ca-a6a5-0ffd59d43ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:42.170785 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-1da1b333-31bc-44ca-a6a5-0ffd59d43ac8 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:42.173742 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-1da1b333-31bc-44ca-a6a5-0ffd59d43ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:42.184411 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3ce41-1830-4ac8-aab1-b3cc3922884e None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:42.219225 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4be42-1f10-4851-9349-6677ca508696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:42.220239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4be42-1f10-4851-9349-6677ca508696 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.220788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4be42-1f10-4851-9349-6677ca508696 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.221243 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4be42-1f10-4851-9349-6677ca508696 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:42.232602 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4be42-1f10-4851-9349-6677ca508696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-81b4be42-1f10-4851-9349-6677ca508696 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:42.238268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:42.239160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:42.239942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:42.239942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:42.239942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:42.239942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:42.239942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:42.239942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:42.239942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:42.239942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:42.239942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:42.239942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:42.239942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:09:42.239942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:09:42.242920 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 35/69] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:42.243910 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4be42-1f10-4851-9349-6677ca508696 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:42.245628 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 35/70] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:09:42.255327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1b333-31bc-44ca-a6a5-0ffd59d43ac8 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:42.296623 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:42.354738 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4be42-1f10-4851-9349-6677ca508696 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:42.373476 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1b333-31bc-44ca-a6a5-0ffd59d43ac8 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:42.380906 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:42.389007 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4318b-f1fc-454f-853f-d534df71b2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:42.389647 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4318b-f1fc-454f-853f-d534df71b2a5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.389929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4318b-f1fc-454f-853f-d534df71b2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.390308 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4318b-f1fc-454f-853f-d534df71b2a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:42.404114 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4318b-f1fc-454f-853f-d534df71b2a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-3ca4318b-f1fc-454f-853f-d534df71b2a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:42.410692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:42.411568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:09:42.412747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 36/71] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:09:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:42.413583 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc33194-50e4-45cf-a006-0ecd7a6ee66a None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.413583 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc33194-50e4-45cf-a006-0ecd7a6ee66a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.413706 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc33194-50e4-45cf-a006-0ecd7a6ee66a None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:42.414920 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 37/72] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:42.417414 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868203fd-cf41-43c8-99db-a52768b82dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:42.418078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868203fd-cf41-43c8-99db-a52768b82dba None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.418421 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868203fd-cf41-43c8-99db-a52768b82dba None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.418716 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868203fd-cf41-43c8-99db-a52768b82dba None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:42.419373 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868203fd-cf41-43c8-99db-a52768b82dba None admin] RBAC: Adding query filter params (name=member) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:42.419669 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc33194-50e4-45cf-a006-0ecd7a6ee66a None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:42.419764 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868203fd-cf41-43c8-99db-a52768b82dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:42.421066 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868203fd-cf41-43c8-99db-a52768b82dba None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:42.434198 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:09:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:42.435479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c415-d9c4-45a5-8faa-7e9d9eceadbf None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.435763 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c415-d9c4-45a5-8faa-7e9d9eceadbf None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.436034 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c415-d9c4-45a5-8faa-7e9d9eceadbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:42.453861 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-95d2c415-d9c4-45a5-8faa-7e9d9eceadbf None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:42.455104 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-95d2c415-d9c4-45a5-8faa-7e9d9eceadbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:42.531907 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 37/74] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:42.542599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2c415-d9c4-45a5-8faa-7e9d9eceadbf None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:42.552916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc33194-50e4-45cf-a006-0ecd7a6ee66a None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:42.565738 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:42.592751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76eb18-1a11-40c0-bb39-3e5a476514ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:42.593414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76eb18-1a11-40c0-bb39-3e5a476514ea None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.593693 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76eb18-1a11-40c0-bb39-3e5a476514ea None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.593964 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76eb18-1a11-40c0-bb39-3e5a476514ea None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:42.594767 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76eb18-1a11-40c0-bb39-3e5a476514ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:42.595073 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76eb18-1a11-40c0-bb39-3e5a476514ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:42.596660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76eb18-1a11-40c0-bb39-3e5a476514ea None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:42.608783 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 38/75] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:42.609591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76eb18-1a11-40c0-bb39-3e5a476514ea None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:42.657589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2c415-d9c4-45a5-8faa-7e9d9eceadbf None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:42.667830 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:42.693091 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2308d-dc3e-455d-8134-0420180cecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:42.693734 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2308d-dc3e-455d-8134-0420180cecbe None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.694029 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2308d-dc3e-455d-8134-0420180cecbe None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.694312 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2308d-dc3e-455d-8134-0420180cecbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:42.704746 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2308d-dc3e-455d-8134-0420180cecbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-1ea2308d-dc3e-455d-8134-0420180cecbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:42.709589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:42.710466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:42.711218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 38/76] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:09:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:42.711879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2308d-dc3e-455d-8134-0420180cecbe None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:42.725714 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76eb18-1a11-40c0-bb39-3e5a476514ea None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:42.760448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c0405-34b8-4dd1-911a-72e9ba8da326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:42.761082 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c0405-34b8-4dd1-911a-72e9ba8da326 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.761356 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c0405-34b8-4dd1-911a-72e9ba8da326 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.761626 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c0405-34b8-4dd1-911a-72e9ba8da326 None admin] PATH_INFO: `/v3/users/c19d4b6580e74231a49a6689514513af` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:42.775426 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c0405-34b8-4dd1-911a-72e9ba8da326 None admin] RBAC: Authorizing `identity:get_user(user_id=c19d4b6580e74231a49a6689514513af)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:42.776896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c0405-34b8-4dd1-911a-72e9ba8da326 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:42.783403 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 39/77] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:42 2022] GET /identity/v3/users/c19d4b6580e74231a49a6689514513af => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:42.783403 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c0405-34b8-4dd1-911a-72e9ba8da326 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:42.800810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:42.821283 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2308d-dc3e-455d-8134-0420180cecbe None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:42.856106 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecf62d-464f-48e8-8713-4bb5be21b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:42.856740 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecf62d-464f-48e8-8713-4bb5be21b13e None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.857008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecf62d-464f-48e8-8713-4bb5be21b13e None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.857284 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecf62d-464f-48e8-8713-4bb5be21b13e None admin] PATH_INFO: `/v3/users/e029965b87334204be7b0f6baa7febea` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:42.858442 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecf62d-464f-48e8-8713-4bb5be21b13e None admin] RBAC: Authorizing `identity:get_user(user_id=e029965b87334204be7b0f6baa7febea)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:42.859913 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecf62d-464f-48e8-8713-4bb5be21b13e None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:42.861480 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 39/78] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:42 2022] GET /identity/v3/users/e029965b87334204be7b0f6baa7febea => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:42.862347 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecf62d-464f-48e8-8713-4bb5be21b13e None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:42.883973 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c0405-34b8-4dd1-911a-72e9ba8da326 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:42.893388 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:42.920471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f424a2a-f86e-48ae-9e38-0057d1a1e586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:42.921103 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f424a2a-f86e-48ae-9e38-0057d1a1e586 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.921381 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f424a2a-f86e-48ae-9e38-0057d1a1e586 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.921653 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f424a2a-f86e-48ae-9e38-0057d1a1e586 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:42.932120 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f424a2a-f86e-48ae-9e38-0057d1a1e586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-5f424a2a-f86e-48ae-9e38-0057d1a1e586 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:42.936929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:42.937948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 40/79] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:42.938907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f424a2a-f86e-48ae-9e38-0057d1a1e586 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:42.965230 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecf62d-464f-48e8-8713-4bb5be21b13e None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:42.998652 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea323e7d-6f1c-4c9d-855e-fba77d2977d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:42.999260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea323e7d-6f1c-4c9d-855e-fba77d2977d6 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:42.999537 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea323e7d-6f1c-4c9d-855e-fba77d2977d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:42.999808 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea323e7d-6f1c-4c9d-855e-fba77d2977d6 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:43.000475 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea323e7d-6f1c-4c9d-855e-fba77d2977d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:43.000803 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea323e7d-6f1c-4c9d-855e-fba77d2977d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:43.002196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea323e7d-6f1c-4c9d-855e-fba77d2977d6 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:43.009990 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 40/80] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:09:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:43.010802 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea323e7d-6f1c-4c9d-855e-fba77d2977d6 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:43.025285 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:43.038585 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f424a2a-f86e-48ae-9e38-0057d1a1e586 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:43.071627 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbefe8-0d89-42ab-8ab0-c6a10bc6a407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:43.072173 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbefe8-0d89-42ab-8ab0-c6a10bc6a407 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:43.072449 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbefe8-0d89-42ab-8ab0-c6a10bc6a407 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:43.072746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbefe8-0d89-42ab-8ab0-c6a10bc6a407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:43.106809 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:43.112091 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea323e7d-6f1c-4c9d-855e-fba77d2977d6 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:43.141383 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbefe8-0d89-42ab-8ab0-c6a10bc6a407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:43.142913 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbefe8-0d89-42ab-8ab0-c6a10bc6a407 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:43.144754 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1caf07-b72d-4f80-bfac-30e044e8212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:43.145387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1caf07-b72d-4f80-bfac-30e044e8212b None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:43.145663 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1caf07-b72d-4f80-bfac-30e044e8212b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:43.145938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1caf07-b72d-4f80-bfac-30e044e8212b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:43.211209 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1caf07-b72d-4f80-bfac-30e044e8212b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:43.212740 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1caf07-b72d-4f80-bfac-30e044e8212b None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:43.226015 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:43.242924 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 41/81] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:09:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:09:43.243772 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbefe8-0d89-42ab-8ab0-c6a10bc6a407 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:43.311798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:43.322561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 41/82] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:09:43.323355 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1caf07-b72d-4f80-bfac-30e044e8212b None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:43.347493 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbefe8-0d89-42ab-8ab0-c6a10bc6a407 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:43.381784 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9170948-3e5a-4f00-a907-eb6376964e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:43.382445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9170948-3e5a-4f00-a907-eb6376964e26 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:43.382725 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9170948-3e5a-4f00-a907-eb6376964e26 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:43.383003 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9170948-3e5a-4f00-a907-eb6376964e26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:43.384106 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9170948-3e5a-4f00-a907-eb6376964e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:43.385563 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9170948-3e5a-4f00-a907-eb6376964e26 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:43.387177 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 42/83] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:09:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:43.387924 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9170948-3e5a-4f00-a907-eb6376964e26 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:43.427168 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1caf07-b72d-4f80-bfac-30e044e8212b None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:43.440313 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:43.461643 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c872938-fa62-434c-999e-ca5e244022fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:43.462286 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c872938-fa62-434c-999e-ca5e244022fd None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:43.462565 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c872938-fa62-434c-999e-ca5e244022fd None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:43.462833 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c872938-fa62-434c-999e-ca5e244022fd None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:43.463494 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c872938-fa62-434c-999e-ca5e244022fd None admin] RBAC: Adding query filter params (name=member) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:43.463790 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c872938-fa62-434c-999e-ca5e244022fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:43.465180 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c872938-fa62-434c-999e-ca5e244022fd None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:43.474240 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 42/84] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:09:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:43.475019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c872938-fa62-434c-999e-ca5e244022fd None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:43.488879 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9170948-3e5a-4f00-a907-eb6376964e26 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:43.522608 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dca2be-a420-4699-9882-1496a49e3ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:43.523245 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dca2be-a420-4699-9882-1496a49e3ea6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:43.523520 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dca2be-a420-4699-9882-1496a49e3ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:43.523793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dca2be-a420-4699-9882-1496a49e3ea6 None admin] PATH_INFO: `/v3/users/c19d4b6580e74231a49a6689514513af` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:43.524941 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dca2be-a420-4699-9882-1496a49e3ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=c19d4b6580e74231a49a6689514513af)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:43.526446 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dca2be-a420-4699-9882-1496a49e3ea6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:43.528023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 43/85] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:43 2022] GET /identity/v3/users/c19d4b6580e74231a49a6689514513af => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:43.529093 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dca2be-a420-4699-9882-1496a49e3ea6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:43.533689 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:43.580001 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c872938-fa62-434c-999e-ca5e244022fd None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:43.613212 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76af807-430e-4a03-bac9-4b93c2bf3f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:43.613870 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76af807-430e-4a03-bac9-4b93c2bf3f10 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:43.614260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76af807-430e-4a03-bac9-4b93c2bf3f10 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:43.614532 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76af807-430e-4a03-bac9-4b93c2bf3f10 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:43.615662 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76af807-430e-4a03-bac9-4b93c2bf3f10 None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:43.617124 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76af807-430e-4a03-bac9-4b93c2bf3f10 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:43.618795 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 43/86] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:43 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:43.619538 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76af807-430e-4a03-bac9-4b93c2bf3f10 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:43.631323 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dca2be-a420-4699-9882-1496a49e3ea6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:43.661680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:43.665864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a127ba2-0aea-47ec-a216-0385cf3bb297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:43.666512 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a127ba2-0aea-47ec-a216-0385cf3bb297 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:43.666786 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a127ba2-0aea-47ec-a216-0385cf3bb297 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:43.667050 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a127ba2-0aea-47ec-a216-0385cf3bb297 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:43.668173 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a127ba2-0aea-47ec-a216-0385cf3bb297 None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:43.669624 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a127ba2-0aea-47ec-a216-0385cf3bb297 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:43.671310 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 44/87] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:43 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:43.672063 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a127ba2-0aea-47ec-a216-0385cf3bb297 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:43.717610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76af807-430e-4a03-bac9-4b93c2bf3f10 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:43.744367 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:43.751150 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075059a-a508-4723-937a-0e2566a34408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:43.751761 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075059a-a508-4723-937a-0e2566a34408 None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:43.752042 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075059a-a508-4723-937a-0e2566a34408 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:43.752318 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075059a-a508-4723-937a-0e2566a34408 None admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:43.752955 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075059a-a508-4723-937a-0e2566a34408 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:43.754445 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075059a-a508-4723-937a-0e2566a34408 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:43.775063 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a127ba2-0aea-47ec-a216-0385cf3bb297 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:43.782576 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 44/88] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 23 16:09:43 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:09:43.783305 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075059a-a508-4723-937a-0e2566a34408 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:43.825101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61fb61-c7b4-4ec2-acb7-d2628a0c9a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:43.825909 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61fb61-c7b4-4ec2-acb7-d2628a0c9a95 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:43.826312 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61fb61-c7b4-4ec2-acb7-d2628a0c9a95 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:43.826679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61fb61-c7b4-4ec2-acb7-d2628a0c9a95 None admin] PATH_INFO: `/v3/users/c19d4b6580e74231a49a6689514513af` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:43.827956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61fb61-c7b4-4ec2-acb7-d2628a0c9a95 None admin] RBAC: Authorizing `identity:get_user(user_id=c19d4b6580e74231a49a6689514513af)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:43.829559 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61fb61-c7b4-4ec2-acb7-d2628a0c9a95 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:43.831656 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 45/89] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:43 2022] GET /identity/v3/users/c19d4b6580e74231a49a6689514513af => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:43.835086 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61fb61-c7b4-4ec2-acb7-d2628a0c9a95 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:43.894465 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:43.898994 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075059a-a508-4723-937a-0e2566a34408 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:43.937964 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fe698-bb2c-4795-8e25-b57541e986f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:43.938722 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fe698-bb2c-4795-8e25-b57541e986f3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:43.939068 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fe698-bb2c-4795-8e25-b57541e986f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:43.939347 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fe698-bb2c-4795-8e25-b57541e986f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:43.958339 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61fb61-c7b4-4ec2-acb7-d2628a0c9a95 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:44.001358 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c6b70-1f85-4180-88b8-f4e1aee3e99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:44.002019 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c6b70-1f85-4180-88b8-f4e1aee3e99a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:44.002296 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c6b70-1f85-4180-88b8-f4e1aee3e99a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:44.002569 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c6b70-1f85-4180-88b8-f4e1aee3e99a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:44.003301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c6b70-1f85-4180-88b8-f4e1aee3e99a None admin] RBAC: Adding query filter params (role.id=9e1823c929634538b474878b5a80c62d, scope.project.id=95d997fd888745edaff8fd28f4d1dde1, user.id=c19d4b6580e74231a49a6689514513af) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:44.003608 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c6b70-1f85-4180-88b8-f4e1aee3e99a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:44.005121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c6b70-1f85-4180-88b8-f4e1aee3e99a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:44.011034 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 46/90] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:09:43 2022] GET /identity/v3/role_assignments?user.id=c19d4b6580e74231a49a6689514513af&scope.project.id=95d997fd888745edaff8fd28f4d1dde1&role.id=9e1823c929634538b474878b5a80c62d => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:44.011632 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c6b70-1f85-4180-88b8-f4e1aee3e99a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:44.018468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fe698-bb2c-4795-8e25-b57541e986f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:44.019962 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fe698-bb2c-4795-8e25-b57541e986f3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:44.023758 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:44.150064 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c6b70-1f85-4180-88b8-f4e1aee3e99a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:44.166871 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:44.172632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 45/91] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:09:44.173466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fe698-bb2c-4795-8e25-b57541e986f3 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:44.198718 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a8f59-5d89-4b05-9b14-d99ab4798dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:44.199357 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a8f59-5d89-4b05-9b14-d99ab4798dd5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:44.199814 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a8f59-5d89-4b05-9b14-d99ab4798dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:44.200082 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a8f59-5d89-4b05-9b14-d99ab4798dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:44.200824 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a8f59-5d89-4b05-9b14-d99ab4798dd5 None admin] RBAC: Adding query filter params (role.id=5756384fa8d842139e2f1fc44c5088bd, scope.project.id=95d997fd888745edaff8fd28f4d1dde1, user.id=e029965b87334204be7b0f6baa7febea) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:44.201140 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a8f59-5d89-4b05-9b14-d99ab4798dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:44.202690 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a8f59-5d89-4b05-9b14-d99ab4798dd5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:44.210891 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 47/92] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:09:44 2022] GET /identity/v3/role_assignments?user.id=e029965b87334204be7b0f6baa7febea&scope.project.id=95d997fd888745edaff8fd28f4d1dde1&role.id=5756384fa8d842139e2f1fc44c5088bd => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:44.211610 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a8f59-5d89-4b05-9b14-d99ab4798dd5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:44.312423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:44.323377 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fe698-bb2c-4795-8e25-b57541e986f3 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:44.364862 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46329880-fe2c-4cf6-9fc8-26d4131dbd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:44.365954 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46329880-fe2c-4cf6-9fc8-26d4131dbd68 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:44.366448 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46329880-fe2c-4cf6-9fc8-26d4131dbd68 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:44.366904 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46329880-fe2c-4cf6-9fc8-26d4131dbd68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:44.400464 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a8f59-5d89-4b05-9b14-d99ab4798dd5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:44.445288 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:44.449975 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46329880-fe2c-4cf6-9fc8-26d4131dbd68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:44.452745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46329880-fe2c-4cf6-9fc8-26d4131dbd68 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:44.479768 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acf603-2823-4bb1-8a27-a53030b1f19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:44.480726 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acf603-2823-4bb1-8a27-a53030b1f19d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:44.481216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acf603-2823-4bb1-8a27-a53030b1f19d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:44.481335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acf603-2823-4bb1-8a27-a53030b1f19d None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:44.486802 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acf603-2823-4bb1-8a27-a53030b1f19d None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:44.488303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acf603-2823-4bb1-8a27-a53030b1f19d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:44.490061 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 48/93] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:44 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:44.496081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acf603-2823-4bb1-8a27-a53030b1f19d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:44.566760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 46/94] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:09:44.572520 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46329880-fe2c-4cf6-9fc8-26d4131dbd68 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:44.702504 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:44.708229 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46329880-fe2c-4cf6-9fc8-26d4131dbd68 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:44.735812 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acf603-2823-4bb1-8a27-a53030b1f19d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:44.748375 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d5fca-2e5d-4509-86d9-3dcc9addb84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:44.749301 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5fca-2e5d-4509-86d9-3dcc9addb84b None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:44.749767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5fca-2e5d-4509-86d9-3dcc9addb84b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:44.750283 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5fca-2e5d-4509-86d9-3dcc9addb84b None admin] PATH_INFO: `/v3/projects/592473bdcdbc43f18e39c2038f8e90b7` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:44.752090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5fca-2e5d-4509-86d9-3dcc9addb84b None admin] RBAC: Authorizing `identity:get_project(project_id=592473bdcdbc43f18e39c2038f8e90b7)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:44.753761 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5fca-2e5d-4509-86d9-3dcc9addb84b None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:44.756539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 47/95] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:44 2022] GET /identity/v3/projects/592473bdcdbc43f18e39c2038f8e90b7 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:44.763216 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d5fca-2e5d-4509-86d9-3dcc9addb84b None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:44.822843 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b3a25-d921-4a4f-b428-a3b48194b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:44.823472 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b3a25-d921-4a4f-b428-a3b48194b618 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:44.823756 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b3a25-d921-4a4f-b428-a3b48194b618 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:44.824029 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b3a25-d921-4a4f-b428-a3b48194b618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:44.824773 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b3a25-d921-4a4f-b428-a3b48194b618 None admin] RBAC: Adding query filter params (role.id=d742fa5aed224c11a39ece1d5178d3ca, scope.project.id=95d997fd888745edaff8fd28f4d1dde1, user.id=c19d4b6580e74231a49a6689514513af) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:44.825082 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b3a25-d921-4a4f-b428-a3b48194b618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:44.826579 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b3a25-d921-4a4f-b428-a3b48194b618 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:44.829743 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:44.836179 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 49/96] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:09:44 2022] GET /identity/v3/role_assignments?user.id=c19d4b6580e74231a49a6689514513af&scope.project.id=95d997fd888745edaff8fd28f4d1dde1&role.id=d742fa5aed224c11a39ece1d5178d3ca => generated 259 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:44.974733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d5fca-2e5d-4509-86d9-3dcc9addb84b None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:45.085744 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99249c-108e-47ec-964c-342a9e4a2938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:45.086403 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99249c-108e-47ec-964c-342a9e4a2938 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:45.086682 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99249c-108e-47ec-964c-342a9e4a2938 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:45.086957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99249c-108e-47ec-964c-342a9e4a2938 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:45.087700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99249c-108e-47ec-964c-342a9e4a2938 None admin] RBAC: Adding query filter params (role.id=9e1823c929634538b474878b5a80c62d, scope.project.id=592473bdcdbc43f18e39c2038f8e90b7, user.id=c19d4b6580e74231a49a6689514513af) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:45.088013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99249c-108e-47ec-964c-342a9e4a2938 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:45.089466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99249c-108e-47ec-964c-342a9e4a2938 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:45.108026 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 48/97] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:09:44 2022] GET /identity/v3/role_assignments?user.id=c19d4b6580e74231a49a6689514513af&scope.project.id=592473bdcdbc43f18e39c2038f8e90b7&role.id=9e1823c929634538b474878b5a80c62d => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:46.991176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4c39d-549e-4ce8-bce7-af09f0d5ebfb None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:46.991699 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4c39d-549e-4ce8-bce7-af09f0d5ebfb None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:46.991699 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4c39d-549e-4ce8-bce7-af09f0d5ebfb None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:46.993218 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 50/98] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:46.998393 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9850cc-1d70-4899-b84e-b40c8074d66b None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:46.998827 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9850cc-1d70-4899-b84e-b40c8074d66b None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:46.999005 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9850cc-1d70-4899-b84e-b40c8074d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:47.019147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-eb9850cc-1d70-4899-b84e-b40c8074d66b None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:47.020418 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-eb9850cc-1d70-4899-b84e-b40c8074d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:47.029026 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242153-cd71-4c84-b4ae-6a919c47193b None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:47.029327 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242153-cd71-4c84-b4ae-6a919c47193b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:47.029576 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242153-cd71-4c84-b4ae-6a919c47193b None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:47.030999 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 51/99] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:47.047815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fa97d-2a3a-4460-aea9-5cdfc5324590 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:47.048139 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fa97d-2a3a-4460-aea9-5cdfc5324590 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:47.048357 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fa97d-2a3a-4460-aea9-5cdfc5324590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:47.065478 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:47.079874 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-017fa97d-2a3a-4460-aea9-5cdfc5324590 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:47.081093 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-017fa97d-2a3a-4460-aea9-5cdfc5324590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:47.150820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 49/100] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:47.199376 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 52/101] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:09:47.508580 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9850cc-1d70-4899-b84e-b40c8074d66b None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:47.610096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9850cc-1d70-4899-b84e-b40c8074d66b None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:47.644870 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e035ef-6839-4e65-915c-24dcb6a4c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:47.645549 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e035ef-6839-4e65-915c-24dcb6a4c52a None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:47.645830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e035ef-6839-4e65-915c-24dcb6a4c52a None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:47.646133 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e035ef-6839-4e65-915c-24dcb6a4c52a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:47.657166 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e035ef-6839-4e65-915c-24dcb6a4c52a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-46e035ef-6839-4e65-915c-24dcb6a4c52a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:47.662067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:47.662893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:47.663632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 50/102] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:09:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:47.669135 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fa97d-2a3a-4460-aea9-5cdfc5324590 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:47.685162 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749f61-3645-426d-af0c-9f19ef055bd8 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:47.685497 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749f61-3645-426d-af0c-9f19ef055bd8 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:47.685702 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749f61-3645-426d-af0c-9f19ef055bd8 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:47.687319 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 51/103] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:09:47.694660 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962b624-1be7-4846-ae23-1ab8c8481cbb None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:47.695007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962b624-1be7-4846-ae23-1ab8c8481cbb None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:47.695212 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962b624-1be7-4846-ae23-1ab8c8481cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:47.724930 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-3962b624-1be7-4846-ae23-1ab8c8481cbb None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:47.726173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-3962b624-1be7-4846-ae23-1ab8c8481cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:47.741936 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:47.797556 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 52/104] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:09:47.836727 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fa97d-2a3a-4460-aea9-5cdfc5324590 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:47.867548 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115233ff-fddd-4f48-93c3-207426c55495 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:47.867854 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115233ff-fddd-4f48-93c3-207426c55495 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:47.868102 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115233ff-fddd-4f48-93c3-207426c55495 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:47.869454 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 53/105] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:47.874057 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115233ff-fddd-4f48-93c3-207426c55495 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:47.879485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:47.886780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23128be2-0a0d-40dc-a93f-037a4dcb88aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:47.887772 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23128be2-0a0d-40dc-a93f-037a4dcb88aa None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:47.888258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23128be2-0a0d-40dc-a93f-037a4dcb88aa None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:47.888716 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23128be2-0a0d-40dc-a93f-037a4dcb88aa None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:47.889623 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23128be2-0a0d-40dc-a93f-037a4dcb88aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:47.890252 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23128be2-0a0d-40dc-a93f-037a4dcb88aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:47.891943 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23128be2-0a0d-40dc-a93f-037a4dcb88aa None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:47.907746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 53/106] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:47.909461 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e36f3-71d9-4dd8-a109-9cf06ae8a9b5 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:47.909935 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e36f3-71d9-4dd8-a109-9cf06ae8a9b5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:47.910428 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e36f3-71d9-4dd8-a109-9cf06ae8a9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:47.951017 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-072e36f3-71d9-4dd8-a109-9cf06ae8a9b5 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:47.952237 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-072e36f3-71d9-4dd8-a109-9cf06ae8a9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:48.025098 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115233ff-fddd-4f48-93c3-207426c55495 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:48.063292 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7febebf-5d75-4a37-9308-8176ef89b85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:48.063908 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7febebf-5d75-4a37-9308-8176ef89b85c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.064187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7febebf-5d75-4a37-9308-8176ef89b85c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.064459 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7febebf-5d75-4a37-9308-8176ef89b85c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.075423 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7febebf-5d75-4a37-9308-8176ef89b85c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-d7febebf-5d75-4a37-9308-8176ef89b85c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:48.080919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:48.081766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:48.082539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 54/107] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:48.086921 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7febebf-5d75-4a37-9308-8176ef89b85c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:48.106360 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:48.167524 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 54/108] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:48.168235 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e36f3-71d9-4dd8-a109-9cf06ae8a9b5 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:48.197215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7febebf-5d75-4a37-9308-8176ef89b85c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:48.240396 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb96ae7-61f6-486d-b048-ef0d70369301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:48.241047 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb96ae7-61f6-486d-b048-ef0d70369301 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.241507 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb96ae7-61f6-486d-b048-ef0d70369301 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.241784 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb96ae7-61f6-486d-b048-ef0d70369301 None admin] PATH_INFO: `/v3/users/e029965b87334204be7b0f6baa7febea` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.243159 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb96ae7-61f6-486d-b048-ef0d70369301 None admin] RBAC: Authorizing `identity:get_user(user_id=e029965b87334204be7b0f6baa7febea)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:48.244733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb96ae7-61f6-486d-b048-ef0d70369301 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:48.246700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 55/109] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:48 2022] GET /identity/v3/users/e029965b87334204be7b0f6baa7febea => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:48.252374 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb96ae7-61f6-486d-b048-ef0d70369301 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:48.346608 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:48.368819 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb96ae7-61f6-486d-b048-ef0d70369301 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:48.404642 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ddb6-a044-448e-852e-701bcc8ba6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:48.405291 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ddb6-a044-448e-852e-701bcc8ba6e6 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.405580 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ddb6-a044-448e-852e-701bcc8ba6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.405857 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ddb6-a044-448e-852e-701bcc8ba6e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.407000 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3ddb6-a044-448e-852e-701bcc8ba6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:48.408472 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3ddb6-a044-448e-852e-701bcc8ba6e6 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:48.410526 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 56/110] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:09:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:09:48.411439 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ddb6-a044-448e-852e-701bcc8ba6e6 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:48.457207 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e36f3-71d9-4dd8-a109-9cf06ae8a9b5 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:48.485105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:48.500773 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b78dc-2201-4a52-9323-90ad7815c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:48.501394 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b78dc-2201-4a52-9323-90ad7815c5f7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.501673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b78dc-2201-4a52-9323-90ad7815c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.504667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b78dc-2201-4a52-9323-90ad7815c5f7 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.504667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b78dc-2201-4a52-9323-90ad7815c5f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:48.504667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b78dc-2201-4a52-9323-90ad7815c5f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:48.504667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b78dc-2201-4a52-9323-90ad7815c5f7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:48.513085 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 55/111] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:09:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:48.515138 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b78dc-2201-4a52-9323-90ad7815c5f7 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:48.525954 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ddb6-a044-448e-852e-701bcc8ba6e6 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:48.561902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91424409-197b-4367-ba85-e1dace90028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:48.562564 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91424409-197b-4367-ba85-e1dace90028d None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.562841 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91424409-197b-4367-ba85-e1dace90028d None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.563142 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91424409-197b-4367-ba85-e1dace90028d None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.564214 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91424409-197b-4367-ba85-e1dace90028d None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:48.565682 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91424409-197b-4367-ba85-e1dace90028d None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:48.572123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 57/112] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:48 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:48.572123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794f978-3865-4ac0-b026-a12e704dd29d None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.572123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794f978-3865-4ac0-b026-a12e704dd29d None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.572123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794f978-3865-4ac0-b026-a12e704dd29d None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.572123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 58/113] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:48.572123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f6564-41d4-43c7-b2cd-31b2919d8a15 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.572587 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f6564-41d4-43c7-b2cd-31b2919d8a15 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.572587 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f6564-41d4-43c7-b2cd-31b2919d8a15 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.573370 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 59/114] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:48.573537 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f6564-41d4-43c7-b2cd-31b2919d8a15 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:48.589305 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:48.637204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b78dc-2201-4a52-9323-90ad7815c5f7 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:48.671418 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c8a0b-5d7a-42f9-8e49-68f0e05ba865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:48.672025 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c8a0b-5d7a-42f9-8e49-68f0e05ba865 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.672302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c8a0b-5d7a-42f9-8e49-68f0e05ba865 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.672573 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c8a0b-5d7a-42f9-8e49-68f0e05ba865 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.673210 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c8a0b-5d7a-42f9-8e49-68f0e05ba865 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:48.674732 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c8a0b-5d7a-42f9-8e49-68f0e05ba865 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:48.675272 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f6564-41d4-43c7-b2cd-31b2919d8a15 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:48.702111 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 56/115] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 23 16:09:48 2022] POST /identity/v3/projects => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:09:48.702938 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c8a0b-5d7a-42f9-8e49-68f0e05ba865 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:48.719196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f144e-686a-49ab-bb7e-9ea775cc709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:48.719867 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f144e-686a-49ab-bb7e-9ea775cc709b None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.720129 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f144e-686a-49ab-bb7e-9ea775cc709b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.720403 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f144e-686a-49ab-bb7e-9ea775cc709b None admin] PATH_INFO: `/v3/users/fb7d696a1c3e4ca68d6203583324330e` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.739307 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f144e-686a-49ab-bb7e-9ea775cc709b None admin] RBAC: Authorizing `identity:get_user(user_id=fb7d696a1c3e4ca68d6203583324330e)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:48.740813 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f144e-686a-49ab-bb7e-9ea775cc709b None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:48.742837 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 60/116] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:48 2022] GET /identity/v3/users/fb7d696a1c3e4ca68d6203583324330e => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:48.744879 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:48.747014 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f144e-686a-49ab-bb7e-9ea775cc709b None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:48.826173 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c8a0b-5d7a-42f9-8e49-68f0e05ba865 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:48.831094 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:48.863178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f144e-686a-49ab-bb7e-9ea775cc709b None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:48.864607 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1baf2b-335f-4ebd-8513-7a7343b703d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:48.865427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1baf2b-335f-4ebd-8513-7a7343b703d3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.866526 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1baf2b-335f-4ebd-8513-7a7343b703d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.866526 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1baf2b-335f-4ebd-8513-7a7343b703d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.877362 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1baf2b-335f-4ebd-8513-7a7343b703d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-4d1baf2b-335f-4ebd-8513-7a7343b703d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:48.882303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:48.883204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:09:48.884057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 57/117] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:48.884739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad607-2a62-47d1-af58-9961eac8324b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.884918 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad607-2a62-47d1-af58-9961eac8324b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.885199 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad607-2a62-47d1-af58-9961eac8324b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.904872 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b09ad607-2a62-47d1-af58-9961eac8324b None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:48.906836 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b09ad607-2a62-47d1-af58-9961eac8324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:48.912831 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbae6b-bb10-4a78-b4e4-d4e6ca21d0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:48.912831 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbae6b-bb10-4a78-b4e4-d4e6ca21d0a0 None admin] REQUEST_METHOD: `PUT` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.913063 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbae6b-bb10-4a78-b4e4-d4e6ca21d0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.913272 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbae6b-bb10-4a78-b4e4-d4e6ca21d0a0 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1/users/e029965b87334204be7b0f6baa7febea/roles/5756384fa8d842139e2f1fc44c5088bd` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.917313 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbae6b-bb10-4a78-b4e4-d4e6ca21d0a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=95d997fd888745edaff8fd28f4d1dde1, user_id=e029965b87334204be7b0f6baa7febea, role_id=5756384fa8d842139e2f1fc44c5088bd)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:48.918942 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbae6b-bb10-4a78-b4e4-d4e6ca21d0a0 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:48.934329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 61/118] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:09:48 2022] PUT /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1/users/e029965b87334204be7b0f6baa7febea/roles/5756384fa8d842139e2f1fc44c5088bd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:09:48.935570 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef6745-154a-44a9-bffe-e8375c28cd0a None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:48.935859 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef6745-154a-44a9-bffe-e8375c28cd0a None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:48.936134 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef6745-154a-44a9-bffe-e8375c28cd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:48.961911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-bfef6745-154a-44a9-bffe-e8375c28cd0a None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:48.963374 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-bfef6745-154a-44a9-bffe-e8375c28cd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:49.000803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 58/119] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:49.001715 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ad607-2a62-47d1-af58-9961eac8324b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:49.038384 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:49.089414 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 62/120] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:49.090186 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef6745-154a-44a9-bffe-e8375c28cd0a None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:49.163821 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ad607-2a62-47d1-af58-9961eac8324b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:49.181431 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:49.208895 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef6745-154a-44a9-bffe-e8375c28cd0a None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:49.253104 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179a7a-992e-459f-b9d6-7f35e7fc450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:49.253742 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179a7a-992e-459f-b9d6-7f35e7fc450d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:49.254043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179a7a-992e-459f-b9d6-7f35e7fc450d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:49.254321 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179a7a-992e-459f-b9d6-7f35e7fc450d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:49.262708 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc68ba-6e14-4ce6-9c4c-6188bd879cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:49.263702 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc68ba-6e14-4ce6-9c4c-6188bd879cce None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:49.264120 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc68ba-6e14-4ce6-9c4c-6188bd879cce None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:49.264530 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc68ba-6e14-4ce6-9c4c-6188bd879cce None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:49.265337 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc68ba-6e14-4ce6-9c4c-6188bd879cce None admin] RBAC: Adding query filter params (name=member) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:49.265785 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc68ba-6e14-4ce6-9c4c-6188bd879cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:49.268258 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc68ba-6e14-4ce6-9c4c-6188bd879cce None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:49.284562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 63/121] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:09:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:49.289965 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc68ba-6e14-4ce6-9c4c-6188bd879cce None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:49.405740 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179a7a-992e-459f-b9d6-7f35e7fc450d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:49.407412 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179a7a-992e-459f-b9d6-7f35e7fc450d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:49.466120 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc68ba-6e14-4ce6-9c4c-6188bd879cce None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:49.468768 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:49.505367 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:49.516412 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd41242-a47d-446f-9254-5d4be10da1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:49.517356 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd41242-a47d-446f-9254-5d4be10da1c8 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:49.517850 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd41242-a47d-446f-9254-5d4be10da1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:49.518351 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd41242-a47d-446f-9254-5d4be10da1c8 None admin] PATH_INFO: `/v3/users/c19d4b6580e74231a49a6689514513af` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:49.520738 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd41242-a47d-446f-9254-5d4be10da1c8 None admin] RBAC: Authorizing `identity:get_user(user_id=c19d4b6580e74231a49a6689514513af)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:49.522518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd41242-a47d-446f-9254-5d4be10da1c8 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:49.527455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 64/122] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:49 2022] GET /identity/v3/users/c19d4b6580e74231a49a6689514513af => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:09:49.528883 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd41242-a47d-446f-9254-5d4be10da1c8 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:49.594123 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 59/123] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:09:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:09:49.595354 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179a7a-992e-459f-b9d6-7f35e7fc450d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:49.659676 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd41242-a47d-446f-9254-5d4be10da1c8 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:49.696256 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa44ba-17c8-413e-ab25-acbbcf4fe9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:49.697362 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa44ba-17c8-413e-ab25-acbbcf4fe9c4 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:49.697937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa44ba-17c8-413e-ab25-acbbcf4fe9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:49.698489 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa44ba-17c8-413e-ab25-acbbcf4fe9c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:49.703784 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179a7a-992e-459f-b9d6-7f35e7fc450d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:49.711288 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa44ba-17c8-413e-ab25-acbbcf4fe9c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-71aa44ba-17c8-413e-ab25-acbbcf4fe9c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:49.717145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:49.717959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:49.719087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:49.719087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:49.719087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:49.719087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:49.719087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:49.719087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:49.719087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:49.719087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:49.719087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:49.719087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:49.719087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:09:49.719087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:49.721212 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 65/124] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:49.722454 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa44ba-17c8-413e-ab25-acbbcf4fe9c4 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:49.730870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:49.740027 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7189-c72f-4e5c-a1bd-f32197cbd8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:49.740674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7189-c72f-4e5c-a1bd-f32197cbd8de None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:49.740957 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7189-c72f-4e5c-a1bd-f32197cbd8de None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:49.741234 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7189-c72f-4e5c-a1bd-f32197cbd8de None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:49.742517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7189-c72f-4e5c-a1bd-f32197cbd8de None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:49.743984 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7189-c72f-4e5c-a1bd-f32197cbd8de None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:49.745864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 60/125] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:49 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:49.746638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7189-c72f-4e5c-a1bd-f32197cbd8de None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:49.782963 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:49.835739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa44ba-17c8-413e-ab25-acbbcf4fe9c4 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:49.856848 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7189-c72f-4e5c-a1bd-f32197cbd8de None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:49.872078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d71fb9-dc17-43de-a332-cdfb1361a064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:49.872989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71fb9-dc17-43de-a332-cdfb1361a064 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:49.873460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71fb9-dc17-43de-a332-cdfb1361a064 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:49.873921 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71fb9-dc17-43de-a332-cdfb1361a064 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:49.885397 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d71fb9-dc17-43de-a332-cdfb1361a064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-26d71fb9-dc17-43de-a332-cdfb1361a064 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:49.891249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:49.892107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:49.892866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:49.892866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:49.892866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:49.892866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:49.892866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:49.892866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:49.892866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:49.892866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:49.892866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:49.892866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:49.892866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:09:49.892866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:49.893475 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f04ef-c89c-4e39-bd66-144214119b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:49.893475 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f04ef-c89c-4e39-bd66-144214119b73 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:49.893475 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f04ef-c89c-4e39-bd66-144214119b73 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:49.893475 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f04ef-c89c-4e39-bd66-144214119b73 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:49.894528 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f04ef-c89c-4e39-bd66-144214119b73 None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:49.895683 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 66/126] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:09:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:49.896008 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f04ef-c89c-4e39-bd66-144214119b73 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:49.897030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d71fb9-dc17-43de-a332-cdfb1361a064 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:49.897741 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 61/127] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:49 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:49.898505 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f04ef-c89c-4e39-bd66-144214119b73 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:49.962503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:50.001101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f04ef-c89c-4e39-bd66-144214119b73 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:50.009706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d71fb9-dc17-43de-a332-cdfb1361a064 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:50.024676 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:50.036540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fb20c-ad93-486b-8e35-658592145885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:50.036984 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fb20c-ad93-486b-8e35-658592145885 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:50.037266 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fb20c-ad93-486b-8e35-658592145885 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:50.037541 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fb20c-ad93-486b-8e35-658592145885 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1/users/c19d4b6580e74231a49a6689514513af/roles/9e1823c929634538b474878b5a80c62d` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:50.039824 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fb20c-ad93-486b-8e35-658592145885 None admin] RBAC: Authorizing `identity:create_grant(project_id=95d997fd888745edaff8fd28f4d1dde1, user_id=c19d4b6580e74231a49a6689514513af, role_id=9e1823c929634538b474878b5a80c62d)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:50.041258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fb20c-ad93-486b-8e35-658592145885 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:50.051262 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0949a5-6a9f-4ea1-afea-07c49b45451f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:50.052375 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0949a5-6a9f-4ea1-afea-07c49b45451f None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:50.053061 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0949a5-6a9f-4ea1-afea-07c49b45451f None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:50.053527 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0949a5-6a9f-4ea1-afea-07c49b45451f None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:50.054522 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0949a5-6a9f-4ea1-afea-07c49b45451f None admin] RBAC: Adding query filter params (name=member) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:50.055188 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0949a5-6a9f-4ea1-afea-07c49b45451f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:50.056840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0949a5-6a9f-4ea1-afea-07c49b45451f None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:50.058432 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 62/128] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:09:49 2022] PUT /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1/users/c19d4b6580e74231a49a6689514513af/roles/9e1823c929634538b474878b5a80c62d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:09:50.066294 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fb20c-ad93-486b-8e35-658592145885 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:50.067542 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 67/129] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:09:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:50.068750 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0949a5-6a9f-4ea1-afea-07c49b45451f None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:50.176785 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0949a5-6a9f-4ea1-afea-07c49b45451f None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:50.223105 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032966c-0948-4e8c-86df-68a36df9c30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:50.224186 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032966c-0948-4e8c-86df-68a36df9c30f None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:50.224670 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032966c-0948-4e8c-86df-68a36df9c30f None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:50.225178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032966c-0948-4e8c-86df-68a36df9c30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:50.226192 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032966c-0948-4e8c-86df-68a36df9c30f None admin] RBAC: Adding query filter params (role.id=f0d638fc9d904725ae87d968c84512df, scope.project.id=95d997fd888745edaff8fd28f4d1dde1, user.id=fb7d696a1c3e4ca68d6203583324330e) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:50.227136 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032966c-0948-4e8c-86df-68a36df9c30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:50.229758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032966c-0948-4e8c-86df-68a36df9c30f None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:50.241912 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fb20c-ad93-486b-8e35-658592145885 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:50.256271 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 68/130] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:09:50 2022] GET /identity/v3/role_assignments?user.id=fb7d696a1c3e4ca68d6203583324330e&scope.project.id=95d997fd888745edaff8fd28f4d1dde1&role.id=f0d638fc9d904725ae87d968c84512df => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:50.257098 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032966c-0948-4e8c-86df-68a36df9c30f None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:50.284325 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57117f-b86a-434a-a0ae-1e75518ecbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:50.285689 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57117f-b86a-434a-a0ae-1e75518ecbe5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:50.286286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57117f-b86a-434a-a0ae-1e75518ecbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:50.286856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57117f-b86a-434a-a0ae-1e75518ecbe5 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:50.288620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57117f-b86a-434a-a0ae-1e75518ecbe5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:50.289225 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57117f-b86a-434a-a0ae-1e75518ecbe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:50.290986 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57117f-b86a-434a-a0ae-1e75518ecbe5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:50.294384 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:50.312600 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 63/131] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:09:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:50.321319 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57117f-b86a-434a-a0ae-1e75518ecbe5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:50.407822 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:50.432772 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57117f-b86a-434a-a0ae-1e75518ecbe5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:50.470988 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1feba-3814-49f7-b3d7-0d99833579ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:50.471646 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1feba-3814-49f7-b3d7-0d99833579ef None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:50.471931 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1feba-3814-49f7-b3d7-0d99833579ef None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:50.472211 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1feba-3814-49f7-b3d7-0d99833579ef None admin] PATH_INFO: `/v3/users/c19d4b6580e74231a49a6689514513af` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:50.474201 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1feba-3814-49f7-b3d7-0d99833579ef None admin] RBAC: Authorizing `identity:get_user(user_id=c19d4b6580e74231a49a6689514513af)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:50.475724 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1feba-3814-49f7-b3d7-0d99833579ef None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:50.477761 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 64/132] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:50 2022] GET /identity/v3/users/c19d4b6580e74231a49a6689514513af => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:50.485293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1feba-3814-49f7-b3d7-0d99833579ef None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:50.574213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032966c-0948-4e8c-86df-68a36df9c30f None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:50.574639 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:50.641736 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33775109-50e6-4284-97e5-2f32d17571a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:50.642416 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33775109-50e6-4284-97e5-2f32d17571a0 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:50.642699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33775109-50e6-4284-97e5-2f32d17571a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:50.642976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33775109-50e6-4284-97e5-2f32d17571a0 None admin] PATH_INFO: `/v3/users/c19d4b6580e74231a49a6689514513af` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:50.644130 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33775109-50e6-4284-97e5-2f32d17571a0 None admin] RBAC: Authorizing `identity:get_user(user_id=c19d4b6580e74231a49a6689514513af)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:50.645653 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33775109-50e6-4284-97e5-2f32d17571a0 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:50.647445 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 69/133] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:50 2022] GET /identity/v3/users/c19d4b6580e74231a49a6689514513af => generated 275 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:50.652756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33775109-50e6-4284-97e5-2f32d17571a0 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:50.678939 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1feba-3814-49f7-b3d7-0d99833579ef None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:50.772254 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33775109-50e6-4284-97e5-2f32d17571a0 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:50.787025 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:50.806375 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db1b01-da8e-425e-9074-6c017a953567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:50.807081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db1b01-da8e-425e-9074-6c017a953567 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:50.807511 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db1b01-da8e-425e-9074-6c017a953567 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:50.807790 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db1b01-da8e-425e-9074-6c017a953567 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:50.814782 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db1b01-da8e-425e-9074-6c017a953567 None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:50.816337 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db1b01-da8e-425e-9074-6c017a953567 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:50.818299 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 65/134] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:50 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:09:50.823869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db1b01-da8e-425e-9074-6c017a953567 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:50.850987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fceee1-69e7-4a2b-8694-27c8e15509e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:50.851573 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fceee1-69e7-4a2b-8694-27c8e15509e4 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:50.851857 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fceee1-69e7-4a2b-8694-27c8e15509e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:50.852137 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fceee1-69e7-4a2b-8694-27c8e15509e4 None admin] PATH_INFO: `/v3/projects/592473bdcdbc43f18e39c2038f8e90b7` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:50.853307 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fceee1-69e7-4a2b-8694-27c8e15509e4 None admin] RBAC: Authorizing `identity:get_project(project_id=592473bdcdbc43f18e39c2038f8e90b7)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:50.854883 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fceee1-69e7-4a2b-8694-27c8e15509e4 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:50.856996 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 70/135] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:50 2022] GET /identity/v3/projects/592473bdcdbc43f18e39c2038f8e90b7 => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:50.863047 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fceee1-69e7-4a2b-8694-27c8e15509e4 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:50.951104 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db1b01-da8e-425e-9074-6c017a953567 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:50.973800 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:50.995741 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ef658-1715-4fee-ad7d-809974271a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:50.996058 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ef658-1715-4fee-ad7d-809974271a3e None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:50.996318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ef658-1715-4fee-ad7d-809974271a3e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:50.996586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ef658-1715-4fee-ad7d-809974271a3e None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1/users/c19d4b6580e74231a49a6689514513af/roles/d742fa5aed224c11a39ece1d5178d3ca` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:51.006367 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ef658-1715-4fee-ad7d-809974271a3e None admin] RBAC: Authorizing `identity:create_grant(project_id=95d997fd888745edaff8fd28f4d1dde1, user_id=c19d4b6580e74231a49a6689514513af, role_id=d742fa5aed224c11a39ece1d5178d3ca)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:51.006367 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ef658-1715-4fee-ad7d-809974271a3e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:51.031021 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 66/136] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:09:50 2022] PUT /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1/users/c19d4b6580e74231a49a6689514513af/roles/d742fa5aed224c11a39ece1d5178d3ca => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:09:51.092835 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fceee1-69e7-4a2b-8694-27c8e15509e4 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:51.149372 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d2639-5bf2-446f-b242-8cd6a6fa0365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:51.150068 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d2639-5bf2-446f-b242-8cd6a6fa0365 None admin] REQUEST_METHOD: `PUT` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:51.150354 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d2639-5bf2-446f-b242-8cd6a6fa0365 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:51.150640 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d2639-5bf2-446f-b242-8cd6a6fa0365 None admin] PATH_INFO: `/v3/projects/592473bdcdbc43f18e39c2038f8e90b7/users/c19d4b6580e74231a49a6689514513af/roles/9e1823c929634538b474878b5a80c62d` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:51.159063 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d2639-5bf2-446f-b242-8cd6a6fa0365 None admin] RBAC: Authorizing `identity:create_grant(project_id=592473bdcdbc43f18e39c2038f8e90b7, user_id=c19d4b6580e74231a49a6689514513af, role_id=9e1823c929634538b474878b5a80c62d)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:51.160644 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d2639-5bf2-446f-b242-8cd6a6fa0365 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:51.176830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 71/137] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:09:50 2022] PUT /identity/v3/projects/592473bdcdbc43f18e39c2038f8e90b7/users/c19d4b6580e74231a49a6689514513af/roles/9e1823c929634538b474878b5a80c62d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:09:51.533401 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f313e-c2da-41c6-9010-cddb44a759be None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:51.534119 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f313e-c2da-41c6-9010-cddb44a759be None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:51.534119 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f313e-c2da-41c6-9010-cddb44a759be None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:51.535522 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 67/138] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:09:51.540958 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909e6a-0392-4667-993b-66885368f761 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:51.541252 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909e6a-0392-4667-993b-66885368f761 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:51.541531 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909e6a-0392-4667-993b-66885368f761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:51.565219 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-5a909e6a-0392-4667-993b-66885368f761 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:51.566535 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-5a909e6a-0392-4667-993b-66885368f761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:51.603307 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:51.609289 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9d495-555c-4c17-9963-149c377dc9b5 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:51.609590 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9d495-555c-4c17-9963-149c377dc9b5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:51.609841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9d495-555c-4c17-9963-149c377dc9b5 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:51.611412 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 68/139] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:51.616625 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79753b3a-9d7d-4dcd-8f5c-da4926ca7044 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:51.616906 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79753b3a-9d7d-4dcd-8f5c-da4926ca7044 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:51.617183 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79753b3a-9d7d-4dcd-8f5c-da4926ca7044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:51.646892 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-79753b3a-9d7d-4dcd-8f5c-da4926ca7044 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:51.648107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-79753b3a-9d7d-4dcd-8f5c-da4926ca7044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:51.673470 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 72/140] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:09:51.766848 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 69/141] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:52.080841 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909e6a-0392-4667-993b-66885368f761 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:52.202131 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909e6a-0392-4667-993b-66885368f761 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:52.239113 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a5dab-a2f4-4815-a543-cb91543b1684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:52.239777 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a5dab-a2f4-4815-a543-cb91543b1684 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:52.240058 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a5dab-a2f4-4815-a543-cb91543b1684 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:52.240398 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a5dab-a2f4-4815-a543-cb91543b1684 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:52.241560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a5dab-a2f4-4815-a543-cb91543b1684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:52.243055 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a5dab-a2f4-4815-a543-cb91543b1684 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:52.244810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 73/142] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:09:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:52.250150 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79753b3a-9d7d-4dcd-8f5c-da4926ca7044 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:52.396015 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79753b3a-9d7d-4dcd-8f5c-da4926ca7044 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:52.413353 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:52.416146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a5dab-a2f4-4815-a543-cb91543b1684 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:52.461435 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951c795-b50a-4d28-8591-ac04fa7b1590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:52.462080 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951c795-b50a-4d28-8591-ac04fa7b1590 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:52.462363 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951c795-b50a-4d28-8591-ac04fa7b1590 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:52.462640 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951c795-b50a-4d28-8591-ac04fa7b1590 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:52.463289 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951c795-b50a-4d28-8591-ac04fa7b1590 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:52.464746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951c795-b50a-4d28-8591-ac04fa7b1590 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:52.478364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:52.508563 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 70/143] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 23 16:09:52 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:09:52.576890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a5dab-a2f4-4815-a543-cb91543b1684 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:52.625778 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2f1c-b7ed-496d-8959-3c00a347596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:52.626511 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2f1c-b7ed-496d-8959-3c00a347596b None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:52.626792 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2f1c-b7ed-496d-8959-3c00a347596b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:52.627061 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2f1c-b7ed-496d-8959-3c00a347596b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:52.639524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b2f1c-b7ed-496d-8959-3c00a347596b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-371b2f1c-b7ed-496d-8959-3c00a347596b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:52.644554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:52.645474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:52.646289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 74/144] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:52.652841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951c795-b50a-4d28-8591-ac04fa7b1590 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:52.802760 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951c795-b50a-4d28-8591-ac04fa7b1590 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:52.854793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36716467-d699-4d97-bccc-00ff650cd4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:52.855418 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36716467-d699-4d97-bccc-00ff650cd4be None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:52.855699 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36716467-d699-4d97-bccc-00ff650cd4be None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:52.855968 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36716467-d699-4d97-bccc-00ff650cd4be None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:52.856660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36716467-d699-4d97-bccc-00ff650cd4be None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:52.857039 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36716467-d699-4d97-bccc-00ff650cd4be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:52.858530 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36716467-d699-4d97-bccc-00ff650cd4be None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:52.867981 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 71/145] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:52.873692 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2f1c-b7ed-496d-8959-3c00a347596b None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:52.996683 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:53.005607 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2f1c-b7ed-496d-8959-3c00a347596b None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:53.042721 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b51d1-704f-4301-850c-78f1c3d82e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:53.043365 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b51d1-704f-4301-850c-78f1c3d82e29 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:53.043644 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b51d1-704f-4301-850c-78f1c3d82e29 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:53.043918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b51d1-704f-4301-850c-78f1c3d82e29 None admin] PATH_INFO: `/v3/users/e029965b87334204be7b0f6baa7febea` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:53.045076 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b51d1-704f-4301-850c-78f1c3d82e29 None admin] RBAC: Authorizing `identity:get_user(user_id=e029965b87334204be7b0f6baa7febea)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:53.049388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b51d1-704f-4301-850c-78f1c3d82e29 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:53.049388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 75/146] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:52 2022] GET /identity/v3/users/e029965b87334204be7b0f6baa7febea => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:53.054966 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36716467-d699-4d97-bccc-00ff650cd4be None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:53.092866 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:53.183967 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36716467-d699-4d97-bccc-00ff650cd4be None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:53.227150 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc52b27-6c9d-4134-8df9-219fa71a2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:53.227766 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc52b27-6c9d-4134-8df9-219fa71a2d0e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:53.228046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc52b27-6c9d-4134-8df9-219fa71a2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:53.228319 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc52b27-6c9d-4134-8df9-219fa71a2d0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:53.328854 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc52b27-6c9d-4134-8df9-219fa71a2d0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:53.330280 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc52b27-6c9d-4134-8df9-219fa71a2d0e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:53.364540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:53.455876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 72/147] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:09:53.461699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b51d1-704f-4301-850c-78f1c3d82e29 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:53.581438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b51d1-704f-4301-850c-78f1c3d82e29 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:53.600536 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757faed4-9652-4196-af2c-bdf007ebcd59 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:53.600851 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757faed4-9652-4196-af2c-bdf007ebcd59 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:53.601080 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757faed4-9652-4196-af2c-bdf007ebcd59 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:53.602488 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 73/148] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:09:53.609102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472882c-6f2f-44ee-9273-f8a5bd53d1cb None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:53.609414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472882c-6f2f-44ee-9273-f8a5bd53d1cb None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:53.609644 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472882c-6f2f-44ee-9273-f8a5bd53d1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:53.626375 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84798eb8-f597-4ec9-b6f9-8ee42dbe66f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:53.627029 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84798eb8-f597-4ec9-b6f9-8ee42dbe66f9 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:53.627309 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84798eb8-f597-4ec9-b6f9-8ee42dbe66f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:53.627581 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84798eb8-f597-4ec9-b6f9-8ee42dbe66f9 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:53.628742 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84798eb8-f597-4ec9-b6f9-8ee42dbe66f9 None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:53.630327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84798eb8-f597-4ec9-b6f9-8ee42dbe66f9 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:53.632189 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 76/149] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:53 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:53.639968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84798eb8-f597-4ec9-b6f9-8ee42dbe66f9 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:53.649159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b472882c-6f2f-44ee-9273-f8a5bd53d1cb None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:53.650765 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b472882c-6f2f-44ee-9273-f8a5bd53d1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:53.672795 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:53.750118 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84798eb8-f597-4ec9-b6f9-8ee42dbe66f9 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:53.788717 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb419b-f045-4107-981d-c64991dd3420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:53.789620 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb419b-f045-4107-981d-c64991dd3420 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:53.790085 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb419b-f045-4107-981d-c64991dd3420 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:53.790507 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb419b-f045-4107-981d-c64991dd3420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:53.791441 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb419b-f045-4107-981d-c64991dd3420 None admin] RBAC: Adding query filter params (role.id=5756384fa8d842139e2f1fc44c5088bd, scope.project.id=95d997fd888745edaff8fd28f4d1dde1, user.id=e029965b87334204be7b0f6baa7febea) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:53.791895 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb419b-f045-4107-981d-c64991dd3420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:53.793513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb419b-f045-4107-981d-c64991dd3420 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:53.800310 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 77/150] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:09:53 2022] GET /identity/v3/role_assignments?user.id=e029965b87334204be7b0f6baa7febea&scope.project.id=95d997fd888745edaff8fd28f4d1dde1&role.id=5756384fa8d842139e2f1fc44c5088bd => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:53.812541 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 74/151] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:53.921768 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c376550-011f-4c07-a7d4-1216e845d763 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:53.922290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c376550-011f-4c07-a7d4-1216e845d763 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:53.922699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c376550-011f-4c07-a7d4-1216e845d763 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:53.924294 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 78/152] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:53.930091 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a62b7-2904-4d7e-b277-ef40c1f1b589 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:53.930375 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a62b7-2904-4d7e-b277-ef40c1f1b589 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:53.930649 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a62b7-2904-4d7e-b277-ef40c1f1b589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:53.954251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-464a62b7-2904-4d7e-b277-ef40c1f1b589 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:53.955462 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-464a62b7-2904-4d7e-b277-ef40c1f1b589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:54.030939 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:54.045381 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 75/153] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:54.285015 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183e128-82b4-4916-a7ca-5f5238535bcb None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:54.285658 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183e128-82b4-4916-a7ca-5f5238535bcb None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:54.286335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183e128-82b4-4916-a7ca-5f5238535bcb None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:54.287892 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 79/154] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:54.293360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2295ed-0409-423f-a867-0e0455bf9b56 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:54.293640 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2295ed-0409-423f-a867-0e0455bf9b56 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:54.293915 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2295ed-0409-423f-a867-0e0455bf9b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:54.314783 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-be2295ed-0409-423f-a867-0e0455bf9b56 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:54.315977 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-be2295ed-0409-423f-a867-0e0455bf9b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:54.389219 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 76/155] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:54.406070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183e128-82b4-4916-a7ca-5f5238535bcb None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:54.518437 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:54.528112 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183e128-82b4-4916-a7ca-5f5238535bcb None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:54.576443 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a22de-56f2-4966-bf4b-ad3a736305be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:54.577012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a22de-56f2-4966-bf4b-ad3a736305be None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:54.577289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a22de-56f2-4966-bf4b-ad3a736305be None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:54.577560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a22de-56f2-4966-bf4b-ad3a736305be None admin] PATH_INFO: `/v3/roles/member` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:54.588627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a22de-56f2-4966-bf4b-ad3a736305be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-1c4a22de-56f2-4966-bf4b-ad3a736305be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:54.593756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:54.602947 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:54.603973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 80/156] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:54.611153 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2295ed-0409-423f-a867-0e0455bf9b56 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:54.685763 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a22de-56f2-4966-bf4b-ad3a736305be None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:54.822033 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a22de-56f2-4966-bf4b-ad3a736305be None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:54.844080 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2295ed-0409-423f-a867-0e0455bf9b56 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:54.860772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3bc3e-b9c4-4e3b-93c1-de14b49f59cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:54.861421 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3bc3e-b9c4-4e3b-93c1-de14b49f59cf None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:54.861700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3bc3e-b9c4-4e3b-93c1-de14b49f59cf None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:54.861977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3bc3e-b9c4-4e3b-93c1-de14b49f59cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:54.873187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3bc3e-b9c4-4e3b-93c1-de14b49f59cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-6ba3bc3e-b9c4-4e3b-93c1-de14b49f59cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:54.879170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:54.880260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:54.881096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 81/157] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:09:54.882474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c86be6-0f76-45dd-9054-392460bb8ebb None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:54.882474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c86be6-0f76-45dd-9054-392460bb8ebb None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:54.882474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c86be6-0f76-45dd-9054-392460bb8ebb None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:54.884039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 82/158] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:54.884624 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c86be6-0f76-45dd-9054-392460bb8ebb None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:54.903477 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:54.910021 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:54.962733 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e2f89-b18d-40de-a121-109848a2d22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:54.963645 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e2f89-b18d-40de-a121-109848a2d22f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:54.964069 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e2f89-b18d-40de-a121-109848a2d22f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:54.964485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e2f89-b18d-40de-a121-109848a2d22f None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:54.965306 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e2f89-b18d-40de-a121-109848a2d22f None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:54.965758 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e2f89-b18d-40de-a121-109848a2d22f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:54.967320 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e2f89-b18d-40de-a121-109848a2d22f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:54.992363 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 77/159] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:09:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:54.993538 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e2f89-b18d-40de-a121-109848a2d22f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:54.998694 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c86be6-0f76-45dd-9054-392460bb8ebb None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:55.037685 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e162cf-0cdb-491a-9e70-212b057faf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:55.038543 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e162cf-0cdb-491a-9e70-212b057faf13 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:55.038831 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e162cf-0cdb-491a-9e70-212b057faf13 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:55.039111 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e162cf-0cdb-491a-9e70-212b057faf13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:55.051230 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e162cf-0cdb-491a-9e70-212b057faf13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-64e162cf-0cdb-491a-9e70-212b057faf13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:55.057213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:55.058352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:55.059200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 83/160] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:55.059837 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed221-86dc-456c-9bd9-79b668a7bc8a None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:55.060022 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed221-86dc-456c-9bd9-79b668a7bc8a None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:55.060450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed221-86dc-456c-9bd9-79b668a7bc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:55.080848 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-b40ed221-86dc-456c-9bd9-79b668a7bc8a None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:55.082444 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-b40ed221-86dc-456c-9bd9-79b668a7bc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:55.157932 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 84/161] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:55.158823 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed221-86dc-456c-9bd9-79b668a7bc8a None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:55.186364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:55.275664 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e2f89-b18d-40de-a121-109848a2d22f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:55.315835 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbc5c4-9699-433f-a210-c39552a42ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:55.316466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbc5c4-9699-433f-a210-c39552a42ab2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:55.316749 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbc5c4-9699-433f-a210-c39552a42ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:55.317026 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbc5c4-9699-433f-a210-c39552a42ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:55.317734 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbc5c4-9699-433f-a210-c39552a42ab2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:55.318058 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbc5c4-9699-433f-a210-c39552a42ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:55.319650 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbc5c4-9699-433f-a210-c39552a42ab2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:55.328627 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 78/162] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:09:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:55.329478 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbc5c4-9699-433f-a210-c39552a42ab2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:55.380523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:55.395988 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed221-86dc-456c-9bd9-79b668a7bc8a None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:55.438486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbc5c4-9699-433f-a210-c39552a42ab2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:55.474268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18239f2-5dc5-48b9-9101-48320d34c9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:55.475350 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18239f2-5dc5-48b9-9101-48320d34c9fe None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:55.475636 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18239f2-5dc5-48b9-9101-48320d34c9fe None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:55.475914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18239f2-5dc5-48b9-9101-48320d34c9fe None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:55.476593 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18239f2-5dc5-48b9-9101-48320d34c9fe None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:55.476901 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18239f2-5dc5-48b9-9101-48320d34c9fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:55.478873 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18239f2-5dc5-48b9-9101-48320d34c9fe None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:55.488196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 79/163] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:09:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:55.489027 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18239f2-5dc5-48b9-9101-48320d34c9fe None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:55.523623 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea482c-a8ec-4c84-87f2-2a7c96d0cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:55.524281 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea482c-a8ec-4c84-87f2-2a7c96d0cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:55.524530 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea482c-a8ec-4c84-87f2-2a7c96d0cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:55.524799 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea482c-a8ec-4c84-87f2-2a7c96d0cdc4 None admin] PATH_INFO: `/v3/users/c19d4b6580e74231a49a6689514513af` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:55.525942 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea482c-a8ec-4c84-87f2-2a7c96d0cdc4 None admin] RBAC: Authorizing `identity:get_user(user_id=c19d4b6580e74231a49a6689514513af)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:55.527417 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea482c-a8ec-4c84-87f2-2a7c96d0cdc4 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:55.529319 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 85/164] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:55 2022] GET /identity/v3/users/c19d4b6580e74231a49a6689514513af => generated 275 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:55.530185 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea482c-a8ec-4c84-87f2-2a7c96d0cdc4 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:55.678288 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18239f2-5dc5-48b9-9101-48320d34c9fe None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:55.682298 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:55.708318 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:55.759552 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea482c-a8ec-4c84-87f2-2a7c96d0cdc4 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:55.777016 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8377c-8d2f-45bb-8845-800f76ee31cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:55.778037 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8377c-8d2f-45bb-8845-800f76ee31cb None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:55.778908 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8377c-8d2f-45bb-8845-800f76ee31cb None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:55.779401 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8377c-8d2f-45bb-8845-800f76ee31cb None admin] PATH_INFO: `/v3/users/fb7d696a1c3e4ca68d6203583324330e` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:55.780739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8377c-8d2f-45bb-8845-800f76ee31cb None admin] RBAC: Authorizing `identity:get_user(user_id=fb7d696a1c3e4ca68d6203583324330e)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:55.782566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8377c-8d2f-45bb-8845-800f76ee31cb None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:55.784405 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 80/165] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:55 2022] GET /identity/v3/users/fb7d696a1c3e4ca68d6203583324330e => generated 289 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:55.785351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8377c-8d2f-45bb-8845-800f76ee31cb None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:55.829236 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ddff7-d9a3-4fca-b9ab-09f61139547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:55.831369 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ddff7-d9a3-4fca-b9ab-09f61139547e None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:55.832022 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ddff7-d9a3-4fca-b9ab-09f61139547e None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:55.833754 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ddff7-d9a3-4fca-b9ab-09f61139547e None admin] PATH_INFO: `/v3/users/c19d4b6580e74231a49a6689514513af` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:55.835134 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ddff7-d9a3-4fca-b9ab-09f61139547e None admin] RBAC: Authorizing `identity:get_user(user_id=c19d4b6580e74231a49a6689514513af)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:55.837471 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ddff7-d9a3-4fca-b9ab-09f61139547e None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:55.839948 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 86/166] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:55 2022] GET /identity/v3/users/c19d4b6580e74231a49a6689514513af => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:55.841091 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ddff7-d9a3-4fca-b9ab-09f61139547e None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:55.983744 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8377c-8d2f-45bb-8845-800f76ee31cb None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:56.045049 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ddff7-d9a3-4fca-b9ab-09f61139547e None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:56.055357 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d057678-4f4d-4cf8-9707-5399de8bb72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:56.055988 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d057678-4f4d-4cf8-9707-5399de8bb72b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:56.056265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d057678-4f4d-4cf8-9707-5399de8bb72b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:56.056533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d057678-4f4d-4cf8-9707-5399de8bb72b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:56.110217 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe210ee-e4c2-4a4c-9927-4bcbd2ca1300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:56.110850 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe210ee-e4c2-4a4c-9927-4bcbd2ca1300 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:56.111119 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe210ee-e4c2-4a4c-9927-4bcbd2ca1300 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:56.111382 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe210ee-e4c2-4a4c-9927-4bcbd2ca1300 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:56.112666 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe210ee-e4c2-4a4c-9927-4bcbd2ca1300 None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:56.114169 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe210ee-e4c2-4a4c-9927-4bcbd2ca1300 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:56.116907 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 87/167] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:55 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:56.120019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe210ee-e4c2-4a4c-9927-4bcbd2ca1300 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:56.139275 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:56.144803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:56.189222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d057678-4f4d-4cf8-9707-5399de8bb72b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:56.191218 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d057678-4f4d-4cf8-9707-5399de8bb72b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:56.257838 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe210ee-e4c2-4a4c-9927-4bcbd2ca1300 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:56.292693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce5f45-0ec2-4872-8e47-4b97b2044763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:56.293597 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce5f45-0ec2-4872-8e47-4b97b2044763 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:56.294045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce5f45-0ec2-4872-8e47-4b97b2044763 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:56.294455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce5f45-0ec2-4872-8e47-4b97b2044763 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:56.305176 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce5f45-0ec2-4872-8e47-4b97b2044763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-85ce5f45-0ec2-4872-8e47-4b97b2044763 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:56.310745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:56.311816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:56.312810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:56.312810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:56.312810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:56.312810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:56.312810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:56.312810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:56.312810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:56.312810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:56.312810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:56.312810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:56.312810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:09:56.312810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:56.314873 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 88/168] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:09:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:56.315783 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce5f45-0ec2-4872-8e47-4b97b2044763 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:56.382419 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:56.392877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 81/169] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:09:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:09:56.393717 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d057678-4f4d-4cf8-9707-5399de8bb72b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:56.421934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce5f45-0ec2-4872-8e47-4b97b2044763 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:56.465036 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7244a6f-065c-420f-b6ec-9c3b5f27dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:56.466285 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7244a6f-065c-420f-b6ec-9c3b5f27dbdb None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:56.467025 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7244a6f-065c-420f-b6ec-9c3b5f27dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:56.467478 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7244a6f-065c-420f-b6ec-9c3b5f27dbdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:56.487435 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:56.519990 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d057678-4f4d-4cf8-9707-5399de8bb72b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:56.551912 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7244a6f-065c-420f-b6ec-9c3b5f27dbdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:56.553815 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7244a6f-065c-420f-b6ec-9c3b5f27dbdb None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:56.559079 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4fc2c-9c36-4e7d-bea3-9ac4974c0506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:56.560070 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4fc2c-9c36-4e7d-bea3-9ac4974c0506 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:56.560558 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4fc2c-9c36-4e7d-bea3-9ac4974c0506 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:56.561062 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4fc2c-9c36-4e7d-bea3-9ac4974c0506 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1/users/fb7d696a1c3e4ca68d6203583324330e/roles/f0d638fc9d904725ae87d968c84512df` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:56.563365 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4fc2c-9c36-4e7d-bea3-9ac4974c0506 None admin] RBAC: Authorizing `identity:create_grant(project_id=95d997fd888745edaff8fd28f4d1dde1, user_id=fb7d696a1c3e4ca68d6203583324330e, role_id=f0d638fc9d904725ae87d968c84512df)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:56.565227 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4fc2c-9c36-4e7d-bea3-9ac4974c0506 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:56.583436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 82/170] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:09:56 2022] PUT /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1/users/fb7d696a1c3e4ca68d6203583324330e/roles/f0d638fc9d904725ae87d968c84512df => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:09:56.584654 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4fc2c-9c36-4e7d-bea3-9ac4974c0506 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:56.625182 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:56.699958 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 89/171] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:09:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:09:56.701208 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7244a6f-065c-420f-b6ec-9c3b5f27dbdb None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:56.762227 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4fc2c-9c36-4e7d-bea3-9ac4974c0506 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:56.811766 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:56.819077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447e9b3-b55e-4841-9d3f-ed7afbd8ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:56.819995 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447e9b3-b55e-4841-9d3f-ed7afbd8ea7b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:56.820400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447e9b3-b55e-4841-9d3f-ed7afbd8ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:56.820806 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447e9b3-b55e-4841-9d3f-ed7afbd8ea7b None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:56.821983 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447e9b3-b55e-4841-9d3f-ed7afbd8ea7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:56.822339 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447e9b3-b55e-4841-9d3f-ed7afbd8ea7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:56.824226 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447e9b3-b55e-4841-9d3f-ed7afbd8ea7b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:56.837042 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 83/172] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:09:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:56.838449 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39629f11-fc33-4231-be4f-96f935db0ea7 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:56.838731 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39629f11-fc33-4231-be4f-96f935db0ea7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:56.839006 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39629f11-fc33-4231-be4f-96f935db0ea7 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:56.840842 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 84/173] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:56.841938 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39629f11-fc33-4231-be4f-96f935db0ea7 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:56.871460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7244a6f-065c-420f-b6ec-9c3b5f27dbdb None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:56.929094 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b2d16-8973-4a9c-a4dd-a9eafb951b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:56.929736 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b2d16-8973-4a9c-a4dd-a9eafb951b78 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:56.930024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b2d16-8973-4a9c-a4dd-a9eafb951b78 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:56.930293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b2d16-8973-4a9c-a4dd-a9eafb951b78 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:56.931582 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b2d16-8973-4a9c-a4dd-a9eafb951b78 None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:56.933129 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b2d16-8973-4a9c-a4dd-a9eafb951b78 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:56.941148 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 90/174] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:56 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:56.942479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a420cd-fccc-4350-9a17-6a73f4fe5bd5 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:56.942755 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a420cd-fccc-4350-9a17-6a73f4fe5bd5 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:56.943020 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a420cd-fccc-4350-9a17-6a73f4fe5bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:56.969295 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39629f11-fc33-4231-be4f-96f935db0ea7 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:56.978846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-45a420cd-fccc-4350-9a17-6a73f4fe5bd5 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:56.980150 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-45a420cd-fccc-4350-9a17-6a73f4fe5bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:57.012059 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aefc3-31c1-453e-9472-fd4d6da1fbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:57.012723 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aefc3-31c1-453e-9472-fd4d6da1fbba None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:57.013069 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aefc3-31c1-453e-9472-fd4d6da1fbba None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:57.013265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aefc3-31c1-453e-9472-fd4d6da1fbba None admin] PATH_INFO: `/v3/projects/592473bdcdbc43f18e39c2038f8e90b7` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:57.014412 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673aefc3-31c1-453e-9472-fd4d6da1fbba None admin] RBAC: Authorizing `identity:get_project(project_id=592473bdcdbc43f18e39c2038f8e90b7)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:57.015921 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673aefc3-31c1-453e-9472-fd4d6da1fbba None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:57.018079 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 85/175] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:56 2022] GET /identity/v3/projects/592473bdcdbc43f18e39c2038f8e90b7 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:57.018920 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aefc3-31c1-453e-9472-fd4d6da1fbba None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:57.024241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:57.075568 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 91/176] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:57.076736 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a420cd-fccc-4350-9a17-6a73f4fe5bd5 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:57.108372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:57.178164 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aefc3-31c1-453e-9472-fd4d6da1fbba None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:57.237820 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc6482-44b6-4517-9ee1-9b3efb8eb7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:57.238505 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc6482-44b6-4517-9ee1-9b3efb8eb7f0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:57.238781 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc6482-44b6-4517-9ee1-9b3efb8eb7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:57.239053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc6482-44b6-4517-9ee1-9b3efb8eb7f0 None admin] PATH_INFO: `/v3/users/c19d4b6580e74231a49a6689514513af` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:57.240247 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc6482-44b6-4517-9ee1-9b3efb8eb7f0 None admin] RBAC: Authorizing `identity:get_user(user_id=c19d4b6580e74231a49a6689514513af)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:57.240855 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a420cd-fccc-4350-9a17-6a73f4fe5bd5 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:57.241702 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc6482-44b6-4517-9ee1-9b3efb8eb7f0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:57.243341 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 86/177] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:57 2022] GET /identity/v3/users/c19d4b6580e74231a49a6689514513af => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:57.244522 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05328cb1-fcb2-4251-a3f0-90ba6ac6ced1 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:57.244803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05328cb1-fcb2-4251-a3f0-90ba6ac6ced1 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:57.245069 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05328cb1-fcb2-4251-a3f0-90ba6ac6ced1 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:57.246285 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 87/178] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:57.246980 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05328cb1-fcb2-4251-a3f0-90ba6ac6ced1 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:57.280815 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f738a53-dd9e-4cba-9453-104ed1d9a638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:57.282028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738a53-dd9e-4cba-9453-104ed1d9a638 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:57.282506 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738a53-dd9e-4cba-9453-104ed1d9a638 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:57.282964 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738a53-dd9e-4cba-9453-104ed1d9a638 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:57.284100 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f738a53-dd9e-4cba-9453-104ed1d9a638 None admin] RBAC: Adding query filter params (role.id=9e1823c929634538b474878b5a80c62d, scope.project.id=95d997fd888745edaff8fd28f4d1dde1, user.id=c19d4b6580e74231a49a6689514513af) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:57.284563 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f738a53-dd9e-4cba-9453-104ed1d9a638 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:57.286176 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f738a53-dd9e-4cba-9453-104ed1d9a638 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:57.292725 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 92/179] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:09:57 2022] GET /identity/v3/role_assignments?user.id=c19d4b6580e74231a49a6689514513af&scope.project.id=95d997fd888745edaff8fd28f4d1dde1&role.id=9e1823c929634538b474878b5a80c62d => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:57.293988 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90914ce-79df-45fc-8476-bbe6be58b62c None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:57.294293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90914ce-79df-45fc-8476-bbe6be58b62c None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:57.294557 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90914ce-79df-45fc-8476-bbe6be58b62c None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:57.295792 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 93/180] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:09:57.300125 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90914ce-79df-45fc-8476-bbe6be58b62c None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:57.351893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:57.418107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05328cb1-fcb2-4251-a3f0-90ba6ac6ced1 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:57.457171 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:57.463621 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdb6e0-9f06-4d1a-b81f-df5452826d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:57.464849 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdb6e0-9f06-4d1a-b81f-df5452826d78 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:57.465410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdb6e0-9f06-4d1a-b81f-df5452826d78 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:57.466115 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdb6e0-9f06-4d1a-b81f-df5452826d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:57.467170 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdb6e0-9f06-4d1a-b81f-df5452826d78 None admin] RBAC: Adding query filter params (role.id=9e1823c929634538b474878b5a80c62d, scope.project.id=592473bdcdbc43f18e39c2038f8e90b7, user.id=c19d4b6580e74231a49a6689514513af) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:57.467804 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdb6e0-9f06-4d1a-b81f-df5452826d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:57.469568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdb6e0-9f06-4d1a-b81f-df5452826d78 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:57.476628 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 88/181] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:09:57 2022] GET /identity/v3/role_assignments?user.id=c19d4b6580e74231a49a6689514513af&scope.project.id=592473bdcdbc43f18e39c2038f8e90b7&role.id=9e1823c929634538b474878b5a80c62d => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:57.477981 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bf6cc-5109-435a-a0d1-9b9abe60f15b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:57.478269 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90914ce-79df-45fc-8476-bbe6be58b62c None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:57.479058 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bf6cc-5109-435a-a0d1-9b9abe60f15b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:57.479332 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bf6cc-5109-435a-a0d1-9b9abe60f15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:57.511781 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-1c9bf6cc-5109-435a-a0d1-9b9abe60f15b None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:57.513568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-1c9bf6cc-5109-435a-a0d1-9b9abe60f15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:57.519138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c73164-52f9-4820-88b0-5c8e774504c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:57.519764 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c73164-52f9-4820-88b0-5c8e774504c3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:57.520038 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c73164-52f9-4820-88b0-5c8e774504c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:57.520303 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c73164-52f9-4820-88b0-5c8e774504c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:57.602270 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 89/182] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:57.604985 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6e896-7c2d-4edf-b079-18578852991c None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:57.605473 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c73164-52f9-4820-88b0-5c8e774504c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:57.606091 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6e896-7c2d-4edf-b079-18578852991c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:57.606571 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6e896-7c2d-4edf-b079-18578852991c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:57.607007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c73164-52f9-4820-88b0-5c8e774504c3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:57.631478 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-c1d6e896-7c2d-4edf-b079-18578852991c None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:57.633828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-c1d6e896-7c2d-4edf-b079-18578852991c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:57.640172 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:57.720274 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 90/183] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:57.721580 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6e896-7c2d-4edf-b079-18578852991c None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:57.728489 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 94/184] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:09:57.731862 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c73164-52f9-4820-88b0-5c8e774504c3 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:57.835956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c73164-52f9-4820-88b0-5c8e774504c3 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:57.843744 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:57.863309 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:57.871265 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116619e-e8ae-4cbf-a981-cc0620d9134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:57.871942 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116619e-e8ae-4cbf-a981-cc0620d9134a None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:57.872219 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116619e-e8ae-4cbf-a981-cc0620d9134a None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:57.872484 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116619e-e8ae-4cbf-a981-cc0620d9134a None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:57.873608 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116619e-e8ae-4cbf-a981-cc0620d9134a None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:57.875091 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116619e-e8ae-4cbf-a981-cc0620d9134a None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:57.877439 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 95/185] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:57 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:57.883995 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116619e-e8ae-4cbf-a981-cc0620d9134a None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:57.915436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6e896-7c2d-4edf-b079-18578852991c None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:57.957621 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227ffc3-b6fa-4e8d-b0cd-1b2cbe20a8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:57.958344 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ffc3-b6fa-4e8d-b0cd-1b2cbe20a8c9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:57.958621 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ffc3-b6fa-4e8d-b0cd-1b2cbe20a8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:57.958893 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ffc3-b6fa-4e8d-b0cd-1b2cbe20a8c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:57.969595 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227ffc3-b6fa-4e8d-b0cd-1b2cbe20a8c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-c227ffc3-b6fa-4e8d-b0cd-1b2cbe20a8c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:57.976637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:57.977547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:09:57.978409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 91/186] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:09:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:57.983511 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227ffc3-b6fa-4e8d-b0cd-1b2cbe20a8c9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:58.022778 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116619e-e8ae-4cbf-a981-cc0620d9134a None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:58.062827 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa925f7-35de-4965-a5dd-07074fef5c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:58.063428 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa925f7-35de-4965-a5dd-07074fef5c40 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:58.063697 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa925f7-35de-4965-a5dd-07074fef5c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:58.064012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa925f7-35de-4965-a5dd-07074fef5c40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:58.064732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa925f7-35de-4965-a5dd-07074fef5c40 None admin] RBAC: Adding query filter params (role.id=d742fa5aed224c11a39ece1d5178d3ca, scope.project.id=95d997fd888745edaff8fd28f4d1dde1, user.id=c19d4b6580e74231a49a6689514513af) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:58.065032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa925f7-35de-4965-a5dd-07074fef5c40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:58.066603 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa925f7-35de-4965-a5dd-07074fef5c40 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:58.074864 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 96/187] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:09:57 2022] GET /identity/v3/role_assignments?user.id=c19d4b6580e74231a49a6689514513af&scope.project.id=95d997fd888745edaff8fd28f4d1dde1&role.id=d742fa5aed224c11a39ece1d5178d3ca => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:58.076045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa925f7-35de-4965-a5dd-07074fef5c40 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:58.095778 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227ffc3-b6fa-4e8d-b0cd-1b2cbe20a8c9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:58.112751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:58.136470 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea52ec1-f1fd-49f5-9eae-af6562c19b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:58.137000 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea52ec1-f1fd-49f5-9eae-af6562c19b22 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:58.137281 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea52ec1-f1fd-49f5-9eae-af6562c19b22 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:58.137556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea52ec1-f1fd-49f5-9eae-af6562c19b22 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:58.138265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea52ec1-f1fd-49f5-9eae-af6562c19b22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:58.138571 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea52ec1-f1fd-49f5-9eae-af6562c19b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:58.140097 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea52ec1-f1fd-49f5-9eae-af6562c19b22 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:58.149923 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 92/188] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:09:58.155325 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:58.156976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea52ec1-f1fd-49f5-9eae-af6562c19b22 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:58.199091 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa925f7-35de-4965-a5dd-07074fef5c40 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:58.236318 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a9953-8f1d-40f5-bf2f-d6c20b4b8075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:58.237360 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9953-8f1d-40f5-bf2f-d6c20b4b8075 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:58.237833 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9953-8f1d-40f5-bf2f-d6c20b4b8075 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:58.238315 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9953-8f1d-40f5-bf2f-d6c20b4b8075 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:58.250465 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a9953-8f1d-40f5-bf2f-d6c20b4b8075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-ab8a9953-8f1d-40f5-bf2f-d6c20b4b8075 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:58.256510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:58.257485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:58.258308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:58.258308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:58.258308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:58.258308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:58.258308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:58.258308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:58.258308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:58.258308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:58.258308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:58.258308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:58.258308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:09:58.258308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:09:58.260641 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 97/189] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:09:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:58.268042 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea52ec1-f1fd-49f5-9eae-af6562c19b22 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:58.268586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a9953-8f1d-40f5-bf2f-d6c20b4b8075 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:58.304777 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fcdc7-8ab5-48f8-989a-08639ced984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:58.305412 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fcdc7-8ab5-48f8-989a-08639ced984a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:58.305692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fcdc7-8ab5-48f8-989a-08639ced984a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:58.305964 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fcdc7-8ab5-48f8-989a-08639ced984a None admin] PATH_INFO: `/v3/users/83d0e55a242047e58738fa7de1c5a6e5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:58.320571 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fcdc7-8ab5-48f8-989a-08639ced984a None admin] RBAC: Authorizing `identity:get_user(user_id=83d0e55a242047e58738fa7de1c5a6e5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:58.322210 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fcdc7-8ab5-48f8-989a-08639ced984a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:58.324219 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 93/190] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:58 2022] GET /identity/v3/users/83d0e55a242047e58738fa7de1c5a6e5 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:09:58.334081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fcdc7-8ab5-48f8-989a-08639ced984a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:58.366318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:58.417472 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a9953-8f1d-40f5-bf2f-d6c20b4b8075 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:58.440403 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fcdc7-8ab5-48f8-989a-08639ced984a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:58.446024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:58.467689 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d902337-a11d-4809-a38d-28e623f7a4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:58.468405 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d902337-a11d-4809-a38d-28e623f7a4ff None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:58.469133 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d902337-a11d-4809-a38d-28e623f7a4ff None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:58.469133 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d902337-a11d-4809-a38d-28e623f7a4ff None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:58.469750 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d902337-a11d-4809-a38d-28e623f7a4ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:58.470150 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d902337-a11d-4809-a38d-28e623f7a4ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:58.471630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d902337-a11d-4809-a38d-28e623f7a4ff None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:58.481284 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 98/191] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:09:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:58.482414 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d902337-a11d-4809-a38d-28e623f7a4ff None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:58.484323 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65890cac-fc0e-43b9-bec3-de0704f7bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:58.485001 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65890cac-fc0e-43b9-bec3-de0704f7bd5d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:58.485346 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65890cac-fc0e-43b9-bec3-de0704f7bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:58.485690 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65890cac-fc0e-43b9-bec3-de0704f7bd5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:58.571158 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65890cac-fc0e-43b9-bec3-de0704f7bd5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:58.573876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65890cac-fc0e-43b9-bec3-de0704f7bd5d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:58.601711 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d902337-a11d-4809-a38d-28e623f7a4ff None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:58.615391 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:58.650781 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b34cf4-d969-43a5-9d93-1444c2b91a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:58.651399 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b34cf4-d969-43a5-9d93-1444c2b91a11 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:58.651651 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b34cf4-d969-43a5-9d93-1444c2b91a11 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:58.651954 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b34cf4-d969-43a5-9d93-1444c2b91a11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:58.653197 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b34cf4-d969-43a5-9d93-1444c2b91a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:58.655025 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b34cf4-d969-43a5-9d93-1444c2b91a11 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:58.661214 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 99/192] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:09:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:58.661214 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b34cf4-d969-43a5-9d93-1444c2b91a11 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:58.697258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 94/193] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:09:58.697933 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65890cac-fc0e-43b9-bec3-de0704f7bd5d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:58.716478 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:58.769556 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b34cf4-d969-43a5-9d93-1444c2b91a11 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:58.805940 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512adec1-aa55-4c05-81b0-41fa37940ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:58.806605 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512adec1-aa55-4c05-81b0-41fa37940ee9 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:58.806882 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512adec1-aa55-4c05-81b0-41fa37940ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:58.806977 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65890cac-fc0e-43b9-bec3-de0704f7bd5d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:58.807163 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512adec1-aa55-4c05-81b0-41fa37940ee9 None admin] PATH_INFO: `/v3/users/83d0e55a242047e58738fa7de1c5a6e5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:58.808278 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512adec1-aa55-4c05-81b0-41fa37940ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=83d0e55a242047e58738fa7de1c5a6e5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:58.809733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512adec1-aa55-4c05-81b0-41fa37940ee9 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:58.811356 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 100/194] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:09:58 2022] GET /identity/v3/users/83d0e55a242047e58738fa7de1c5a6e5 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:58.812125 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512adec1-aa55-4c05-81b0-41fa37940ee9 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:58.845617 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ffd5f-a9d5-4597-8bcf-2e4c8700a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:58.847069 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ffd5f-a9d5-4597-8bcf-2e4c8700a042 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:58.847570 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ffd5f-a9d5-4597-8bcf-2e4c8700a042 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:58.848052 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ffd5f-a9d5-4597-8bcf-2e4c8700a042 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:58.848951 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ffd5f-a9d5-4597-8bcf-2e4c8700a042 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:58.850703 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ffd5f-a9d5-4597-8bcf-2e4c8700a042 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:58.859349 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:58.874232 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 95/195] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 23 16:09:58 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:09:58.879277 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ffd5f-a9d5-4597-8bcf-2e4c8700a042 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:58.937575 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512adec1-aa55-4c05-81b0-41fa37940ee9 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:58.965311 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:58.992137 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce867de-89ae-44f5-98ec-ae076f0216cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:58.992973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce867de-89ae-44f5-98ec-ae076f0216cc None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:58.993363 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce867de-89ae-44f5-98ec-ae076f0216cc None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:58.993705 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce867de-89ae-44f5-98ec-ae076f0216cc None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:58.995604 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce867de-89ae-44f5-98ec-ae076f0216cc None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:58.997730 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce867de-89ae-44f5-98ec-ae076f0216cc None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:59.000170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 101/196] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:58 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:59.006553 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce867de-89ae-44f5-98ec-ae076f0216cc None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:59.031456 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ffd5f-a9d5-4597-8bcf-2e4c8700a042 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:59.087190 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b671b4-18c8-40f1-80d0-6c12c7f6b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:59.088991 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b671b4-18c8-40f1-80d0-6c12c7f6b84d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:59.089271 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b671b4-18c8-40f1-80d0-6c12c7f6b84d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:59.089540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b671b4-18c8-40f1-80d0-6c12c7f6b84d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:59.144803 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce867de-89ae-44f5-98ec-ae076f0216cc None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:59.169327 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:59.183164 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b671b4-18c8-40f1-80d0-6c12c7f6b84d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:59.184771 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b671b4-18c8-40f1-80d0-6c12c7f6b84d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:59.192899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49daac67-ce0c-4a51-a09d-cdadc71de8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:59.193534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49daac67-ce0c-4a51-a09d-cdadc71de8f1 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:59.193783 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49daac67-ce0c-4a51-a09d-cdadc71de8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:59.194087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49daac67-ce0c-4a51-a09d-cdadc71de8f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:59.194822 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49daac67-ce0c-4a51-a09d-cdadc71de8f1 None admin] RBAC: Adding query filter params (role.id=5756384fa8d842139e2f1fc44c5088bd, scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5, user.id=83d0e55a242047e58738fa7de1c5a6e5) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:59.195126 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49daac67-ce0c-4a51-a09d-cdadc71de8f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:59.197403 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49daac67-ce0c-4a51-a09d-cdadc71de8f1 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:59.204719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 102/197] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:09:59 2022] GET /identity/v3/role_assignments?user.id=83d0e55a242047e58738fa7de1c5a6e5&scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5&role.id=5756384fa8d842139e2f1fc44c5088bd => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:59.218464 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87654b4-7848-4136-bb92-64142f0f1f4e None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:59.218643 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87654b4-7848-4136-bb92-64142f0f1f4e None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:59.218918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87654b4-7848-4136-bb92-64142f0f1f4e None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:59.221610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 103/198] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:09:59.226684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520fe19-9191-4761-8d2d-d918172f5bbf None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:59.227246 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520fe19-9191-4761-8d2d-d918172f5bbf None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:59.227649 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520fe19-9191-4761-8d2d-d918172f5bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:59.250125 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-1520fe19-9191-4761-8d2d-d918172f5bbf None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:09:59.251383 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-1520fe19-9191-4761-8d2d-d918172f5bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:09:59.328451 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 96/199] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:09:59.333888 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:59.334789 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b671b4-18c8-40f1-80d0-6c12c7f6b84d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:59.364169 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 104/200] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:09:59.450042 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:09:59.460724 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b671b4-18c8-40f1-80d0-6c12c7f6b84d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:59.496543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c61e2e-785f-47cb-a2f0-824264d80970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:59.497092 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c61e2e-785f-47cb-a2f0-824264d80970 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:59.497365 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c61e2e-785f-47cb-a2f0-824264d80970 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:59.497634 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c61e2e-785f-47cb-a2f0-824264d80970 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:59.499019 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c61e2e-785f-47cb-a2f0-824264d80970 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:59.500547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c61e2e-785f-47cb-a2f0-824264d80970 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:59.502643 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 97/201] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:09:59 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:59.510754 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520fe19-9191-4761-8d2d-d918172f5bbf None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:59.664704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520fe19-9191-4761-8d2d-d918172f5bbf None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:59.712053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb13cb-6c0f-41dd-abbb-ce9d549a47ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:59.712674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb13cb-6c0f-41dd-abbb-ce9d549a47ec None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:59.712954 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb13cb-6c0f-41dd-abbb-ce9d549a47ec None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:59.713224 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb13cb-6c0f-41dd-abbb-ce9d549a47ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:59.713962 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb13cb-6c0f-41dd-abbb-ce9d549a47ec None admin] RBAC: Adding query filter params (role.id=d742fa5aed224c11a39ece1d5178d3ca, scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5, user.id=83d0e55a242047e58738fa7de1c5a6e5) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:09:59.714289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb13cb-6c0f-41dd-abbb-ce9d549a47ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:09:59.715895 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb13cb-6c0f-41dd-abbb-ce9d549a47ec None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:09:59.726298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 105/202] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:09:59 2022] GET /identity/v3/role_assignments?user.id=83d0e55a242047e58738fa7de1c5a6e5&scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5&role.id=d742fa5aed224c11a39ece1d5178d3ca => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:09:59.749570 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c61e2e-785f-47cb-a2f0-824264d80970 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:09:59.868568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c61e2e-785f-47cb-a2f0-824264d80970 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:09:59.913849 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb2bbb-fdd2-48bb-a5f5-3958b1c296ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:09:59.914599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb2bbb-fdd2-48bb-a5f5-3958b1c296ad None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:09:59.914817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb2bbb-fdd2-48bb-a5f5-3958b1c296ad None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:09:59.915088 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb2bbb-fdd2-48bb-a5f5-3958b1c296ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:09:59.931852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb2bbb-fdd2-48bb-a5f5-3958b1c296ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-cebb2bbb-fdd2-48bb-a5f5-3958b1c296ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:09:59.936692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:09:59.937551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:09:59.938458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 98/203] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:09:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:09:59.947136 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb13cb-6c0f-41dd-abbb-ce9d549a47ec None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:00.012394 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:00.094991 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb13cb-6c0f-41dd-abbb-ce9d549a47ec None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:00.145435 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d83901-e6e0-4aca-a031-2dab7d1b7529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:00.146189 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d83901-e6e0-4aca-a031-2dab7d1b7529 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:00.146467 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d83901-e6e0-4aca-a031-2dab7d1b7529 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:00.146735 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d83901-e6e0-4aca-a031-2dab7d1b7529 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:00.147392 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d83901-e6e0-4aca-a031-2dab7d1b7529 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:00.147739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d83901-e6e0-4aca-a031-2dab7d1b7529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:00.149186 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d83901-e6e0-4aca-a031-2dab7d1b7529 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:00.160998 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 106/204] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:09:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:00.166993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb2bbb-fdd2-48bb-a5f5-3958b1c296ad None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:00.195139 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:00.292177 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb2bbb-fdd2-48bb-a5f5-3958b1c296ad None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:00.333702 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c8d9e-5134-4010-a08f-2711aa7b969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:00.334391 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c8d9e-5134-4010-a08f-2711aa7b969b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:00.334670 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c8d9e-5134-4010-a08f-2711aa7b969b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:00.334939 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c8d9e-5134-4010-a08f-2711aa7b969b None admin] PATH_INFO: `/v3/users/fb7d696a1c3e4ca68d6203583324330e` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:00.338685 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c8d9e-5134-4010-a08f-2711aa7b969b None admin] RBAC: Authorizing `identity:get_user(user_id=fb7d696a1c3e4ca68d6203583324330e)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:00.340287 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c8d9e-5134-4010-a08f-2711aa7b969b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:00.342329 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 99/205] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:00 2022] GET /identity/v3/users/fb7d696a1c3e4ca68d6203583324330e => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:00.348830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d83901-e6e0-4aca-a031-2dab7d1b7529 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:00.515353 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d83901-e6e0-4aca-a031-2dab7d1b7529 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:00.528256 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:00.569695 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6efa9b-4655-43b0-928b-38254c3f7ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:00.570273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6efa9b-4655-43b0-928b-38254c3f7ac3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:00.570549 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6efa9b-4655-43b0-928b-38254c3f7ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:00.570816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6efa9b-4655-43b0-928b-38254c3f7ac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:00.665312 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6efa9b-4655-43b0-928b-38254c3f7ac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:00.667538 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6efa9b-4655-43b0-928b-38254c3f7ac3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:00.813351 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 107/206] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:00.820002 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c8d9e-5134-4010-a08f-2711aa7b969b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:00.947571 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:00.962632 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c8d9e-5134-4010-a08f-2711aa7b969b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:00.998551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6978b0-9313-407c-ba36-c605b94b09dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:00.999200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6978b0-9313-407c-ba36-c605b94b09dd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:00.999479 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6978b0-9313-407c-ba36-c605b94b09dd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:00.999748 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6978b0-9313-407c-ba36-c605b94b09dd None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:01.000945 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6978b0-9313-407c-ba36-c605b94b09dd None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:01.002597 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6978b0-9313-407c-ba36-c605b94b09dd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:01.004678 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 100/207] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:00 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:01.010678 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6efa9b-4655-43b0-928b-38254c3f7ac3 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:01.034366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:01.142694 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6efa9b-4655-43b0-928b-38254c3f7ac3 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:01.185709 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc55d2-7b68-42fa-9981-677d482a7089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:01.186348 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc55d2-7b68-42fa-9981-677d482a7089 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:01.186622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc55d2-7b68-42fa-9981-677d482a7089 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:01.186891 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc55d2-7b68-42fa-9981-677d482a7089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:01.187629 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc55d2-7b68-42fa-9981-677d482a7089 None admin] RBAC: Adding query filter params (role.id=f0d638fc9d904725ae87d968c84512df, scope.project.id=95d997fd888745edaff8fd28f4d1dde1, user.id=fb7d696a1c3e4ca68d6203583324330e) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:01.187932 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc55d2-7b68-42fa-9981-677d482a7089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:01.189388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc55d2-7b68-42fa-9981-677d482a7089 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:01.195984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 108/208] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:01 2022] GET /identity/v3/role_assignments?user.id=fb7d696a1c3e4ca68d6203583324330e&scope.project.id=95d997fd888745edaff8fd28f4d1dde1&role.id=f0d638fc9d904725ae87d968c84512df => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:01.692558 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8105e63-2166-4b1c-82bc-03f66a47e3be None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:01.693098 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8105e63-2166-4b1c-82bc-03f66a47e3be None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:01.693098 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8105e63-2166-4b1c-82bc-03f66a47e3be None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:01.694799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 101/209] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:01.700582 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e616261-5efa-40aa-bd77-fe25adf3ab7d None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:01.701054 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e616261-5efa-40aa-bd77-fe25adf3ab7d None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:01.701154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e616261-5efa-40aa-bd77-fe25adf3ab7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:01.722645 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-9e616261-5efa-40aa-bd77-fe25adf3ab7d None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:01.723969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-9e616261-5efa-40aa-bd77-fe25adf3ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:01.803257 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:01.811709 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 109/210] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:01.912949 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ff9c2-550a-4d28-aab8-f72f9f2ff1df None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:01.913225 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ff9c2-550a-4d28-aab8-f72f9f2ff1df None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:01.913505 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ff9c2-550a-4d28-aab8-f72f9f2ff1df None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:01.914922 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 102/211] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:01.920339 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b8ed-5137-4c9b-b962-5d25dce56022 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:01.920625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b8ed-5137-4c9b-b962-5d25dce56022 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:01.920901 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b8ed-5137-4c9b-b962-5d25dce56022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:01.939474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-0f02b8ed-5137-4c9b-b962-5d25dce56022 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:01.940680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-0f02b8ed-5137-4c9b-b962-5d25dce56022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:01.959746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54800ba1-95aa-4b70-982e-4af5af6fff78 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:01.960015 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54800ba1-95aa-4b70-982e-4af5af6fff78 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:01.960517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54800ba1-95aa-4b70-982e-4af5af6fff78 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:01.962077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 103/212] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:01.967400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ddcd9-e55a-43dc-9da4-d5b23a6c2714 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:01.967890 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ddcd9-e55a-43dc-9da4-d5b23a6c2714 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:01.968347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ddcd9-e55a-43dc-9da4-d5b23a6c2714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:01.987610 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-bf5ddcd9-e55a-43dc-9da4-d5b23a6c2714 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:01.989285 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-bf5ddcd9-e55a-43dc-9da4-d5b23a6c2714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:02.009853 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 110/213] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:02.059089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 104/214] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:02.153135 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02b8ed-5137-4c9b-b962-5d25dce56022 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:02.263375 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02b8ed-5137-4c9b-b962-5d25dce56022 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:02.295835 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:02.303160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd16782-b657-418a-b8f7-13fb4dec1656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:02.303804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd16782-b657-418a-b8f7-13fb4dec1656 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:02.304081 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd16782-b657-418a-b8f7-13fb4dec1656 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:02.304351 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd16782-b657-418a-b8f7-13fb4dec1656 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:02.315500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd16782-b657-418a-b8f7-13fb4dec1656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-1bd16782-b657-418a-b8f7-13fb4dec1656 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:02.320350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:02.321221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:02.322051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 111/215] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:02.328666 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ddcd9-e55a-43dc-9da4-d5b23a6c2714 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:02.336332 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd16782-b657-418a-b8f7-13fb4dec1656 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:02.428895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:02.443032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd16782-b657-418a-b8f7-13fb4dec1656 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:02.445316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ddcd9-e55a-43dc-9da4-d5b23a6c2714 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:02.476794 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ef02-10c5-480b-addc-78d5a3113a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:02.477427 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ef02-10c5-480b-addc-78d5a3113a4e None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:02.477702 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ef02-10c5-480b-addc-78d5a3113a4e None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:02.477970 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ef02-10c5-480b-addc-78d5a3113a4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:02.478190 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86412314-3805-4a5c-bd81-6757635633c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:02.478793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86412314-3805-4a5c-bd81-6757635633c9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:02.479070 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86412314-3805-4a5c-bd81-6757635633c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:02.479160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9ef02-10c5-480b-addc-78d5a3113a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:02.479342 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86412314-3805-4a5c-bd81-6757635633c9 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:02.480004 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86412314-3805-4a5c-bd81-6757635633c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:02.480307 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86412314-3805-4a5c-bd81-6757635633c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:02.480552 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9ef02-10c5-480b-addc-78d5a3113a4e None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:02.481659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86412314-3805-4a5c-bd81-6757635633c9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:02.482187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 112/216] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:02.484171 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ef02-10c5-480b-addc-78d5a3113a4e None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:02.494916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 105/217] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:02.494916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819348f-ba76-4125-a8a3-80f85104a25a None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:02.494916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819348f-ba76-4125-a8a3-80f85104a25a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:02.494916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819348f-ba76-4125-a8a3-80f85104a25a None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:02.494916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 106/218] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:02.494916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819348f-ba76-4125-a8a3-80f85104a25a None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:02.548198 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:02.592681 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ef02-10c5-480b-addc-78d5a3113a4e None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:02.597334 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819348f-ba76-4125-a8a3-80f85104a25a None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:02.628514 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d643b2-d983-4b9b-97ab-cd99276f83fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:02.629142 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d643b2-d983-4b9b-97ab-cd99276f83fd None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:02.629440 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d643b2-d983-4b9b-97ab-cd99276f83fd None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:02.629703 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d643b2-d983-4b9b-97ab-cd99276f83fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:02.631660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9752287-1cc6-411a-b708-609c15a2963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:02.632275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9752287-1cc6-411a-b708-609c15a2963a None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:02.632553 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9752287-1cc6-411a-b708-609c15a2963a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:02.632819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9752287-1cc6-411a-b708-609c15a2963a None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:02.633458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9752287-1cc6-411a-b708-609c15a2963a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:02.634949 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9752287-1cc6-411a-b708-609c15a2963a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:02.639815 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d643b2-d983-4b9b-97ab-cd99276f83fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-61d643b2-d983-4b9b-97ab-cd99276f83fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:02.644989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:02.645846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:02.646669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 113/219] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:10:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:02.647317 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d643b2-d983-4b9b-97ab-cd99276f83fd None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:02.660545 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 107/220] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 23 16:10:02 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:10:02.661807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df3df6-52f9-4cf8-982b-437f1496e655 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:02.662119 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df3df6-52f9-4cf8-982b-437f1496e655 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:02.662394 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df3df6-52f9-4cf8-982b-437f1496e655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:02.668944 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:02.687412 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-20df3df6-52f9-4cf8-982b-437f1496e655 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:02.688640 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-20df3df6-52f9-4cf8-982b-437f1496e655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:02.762513 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 108/221] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:02.764148 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df3df6-52f9-4cf8-982b-437f1496e655 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:02.790346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d643b2-d983-4b9b-97ab-cd99276f83fd None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:02.811218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:02.831918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd26db-9138-4019-a7d1-ffd6c09da66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:02.832658 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd26db-9138-4019-a7d1-ffd6c09da66b None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:02.833168 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd26db-9138-4019-a7d1-ffd6c09da66b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:02.833507 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd26db-9138-4019-a7d1-ffd6c09da66b None admin] PATH_INFO: `/v3/users/55693debeb944df28bd1453ad9955124` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:02.853888 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd26db-9138-4019-a7d1-ffd6c09da66b None admin] RBAC: Authorizing `identity:get_user(user_id=55693debeb944df28bd1453ad9955124)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:02.855633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd26db-9138-4019-a7d1-ffd6c09da66b None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:02.857671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 114/222] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:02 2022] GET /identity/v3/users/55693debeb944df28bd1453ad9955124 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:02.863628 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd26db-9138-4019-a7d1-ffd6c09da66b None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:02.904659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df3df6-52f9-4cf8-982b-437f1496e655 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:02.938103 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:02.944150 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa0441-38d6-46fc-9c6e-be63957c95aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:02.944958 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa0441-38d6-46fc-9c6e-be63957c95aa None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:02.945323 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa0441-38d6-46fc-9c6e-be63957c95aa None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:02.945655 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa0441-38d6-46fc-9c6e-be63957c95aa None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:02.946460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa0441-38d6-46fc-9c6e-be63957c95aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:02.946827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa0441-38d6-46fc-9c6e-be63957c95aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:02.948335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa0441-38d6-46fc-9c6e-be63957c95aa None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:02.957510 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 109/223] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:02.963144 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa0441-38d6-46fc-9c6e-be63957c95aa None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:02.981974 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd26db-9138-4019-a7d1-ffd6c09da66b None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:03.027495 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94f19-f370-4bb2-8875-72386bb14d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:03.028112 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94f19-f370-4bb2-8875-72386bb14d5e None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:03.028389 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94f19-f370-4bb2-8875-72386bb14d5e None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:03.028656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94f19-f370-4bb2-8875-72386bb14d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:03.080586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa0441-38d6-46fc-9c6e-be63957c95aa None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:03.087474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:03.117368 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f94f19-f370-4bb2-8875-72386bb14d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:03.118813 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f94f19-f370-4bb2-8875-72386bb14d5e None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:03.125105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af180b-aa77-46d2-95c7-99a6b9dbadba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:03.125968 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af180b-aa77-46d2-95c7-99a6b9dbadba None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:03.126425 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af180b-aa77-46d2-95c7-99a6b9dbadba None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:03.126845 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af180b-aa77-46d2-95c7-99a6b9dbadba None admin] PATH_INFO: `/v3/users/83d0e55a242047e58738fa7de1c5a6e5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:03.128007 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af180b-aa77-46d2-95c7-99a6b9dbadba None admin] RBAC: Authorizing `identity:get_user(user_id=83d0e55a242047e58738fa7de1c5a6e5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:03.129463 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af180b-aa77-46d2-95c7-99a6b9dbadba None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:03.131339 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 110/224] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:02 2022] GET /identity/v3/users/83d0e55a242047e58738fa7de1c5a6e5 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:03.132120 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af180b-aa77-46d2-95c7-99a6b9dbadba None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:03.195497 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:03.238948 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 115/225] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:03.242125 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94f19-f370-4bb2-8875-72386bb14d5e None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:03.255262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af180b-aa77-46d2-95c7-99a6b9dbadba None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:03.294025 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff6938-e500-4f05-9a50-bc43ecd3dc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:03.294227 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff6938-e500-4f05-9a50-bc43ecd3dc57 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:03.294460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff6938-e500-4f05-9a50-bc43ecd3dc57 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:03.296257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff6938-e500-4f05-9a50-bc43ecd3dc57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:03.305647 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff6938-e500-4f05-9a50-bc43ecd3dc57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-d0ff6938-e500-4f05-9a50-bc43ecd3dc57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:03.311200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:03.312076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:03.312852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 111/226] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:10:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:03.313513 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff6938-e500-4f05-9a50-bc43ecd3dc57 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:03.336825 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:03.363256 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94f19-f370-4bb2-8875-72386bb14d5e None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:03.401655 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69726a-9237-4db4-829d-d243dc8f5e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:03.402649 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69726a-9237-4db4-829d-d243dc8f5e66 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:03.403156 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69726a-9237-4db4-829d-d243dc8f5e66 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:03.403561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69726a-9237-4db4-829d-d243dc8f5e66 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:03.405496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69726a-9237-4db4-829d-d243dc8f5e66 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:03.408255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69726a-9237-4db4-829d-d243dc8f5e66 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:03.410583 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 116/227] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:03 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:03.411820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69726a-9237-4db4-829d-d243dc8f5e66 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:03.417434 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff6938-e500-4f05-9a50-bc43ecd3dc57 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:03.441091 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:03.453074 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1a2a3-ce7d-40a7-a55a-aa4c4c629a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:03.453713 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1a2a3-ce7d-40a7-a55a-aa4c4c629a43 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:03.453988 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1a2a3-ce7d-40a7-a55a-aa4c4c629a43 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:03.454284 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1a2a3-ce7d-40a7-a55a-aa4c4c629a43 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:03.455470 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1a2a3-ce7d-40a7-a55a-aa4c4c629a43 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:03.457294 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1a2a3-ce7d-40a7-a55a-aa4c4c629a43 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:03.459692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 112/228] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:03 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:03.460149 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1a2a3-ce7d-40a7-a55a-aa4c4c629a43 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:03.527305 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69726a-9237-4db4-829d-d243dc8f5e66 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:03.565121 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c3e31-9b66-420c-ad40-2a6adf20d3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:03.566126 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c3e31-9b66-420c-ad40-2a6adf20d3d3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:03.566645 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c3e31-9b66-420c-ad40-2a6adf20d3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:03.567151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c3e31-9b66-420c-ad40-2a6adf20d3d3 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:03.568116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c3e31-9b66-420c-ad40-2a6adf20d3d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:03.568608 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c3e31-9b66-420c-ad40-2a6adf20d3d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:03.570366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c3e31-9b66-420c-ad40-2a6adf20d3d3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:03.576638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1a2a3-ce7d-40a7-a55a-aa4c4c629a43 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:03.579755 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 117/229] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:03.585422 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c3e31-9b66-420c-ad40-2a6adf20d3d3 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:03.595386 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:03.611746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd58b3-d2e2-40a2-9fa3-b6f857a14acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:03.612312 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd58b3-d2e2-40a2-9fa3-b6f857a14acd None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:03.612597 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd58b3-d2e2-40a2-9fa3-b6f857a14acd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:03.612874 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd58b3-d2e2-40a2-9fa3-b6f857a14acd None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5/users/83d0e55a242047e58738fa7de1c5a6e5/roles/5756384fa8d842139e2f1fc44c5088bd` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:03.614909 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd58b3-d2e2-40a2-9fa3-b6f857a14acd None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e0550c0f8641509cb6701c49c8e0f5, user_id=83d0e55a242047e58738fa7de1c5a6e5, role_id=5756384fa8d842139e2f1fc44c5088bd)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:03.616586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd58b3-d2e2-40a2-9fa3-b6f857a14acd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:03.637856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 113/230] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:10:03 2022] PUT /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5/users/83d0e55a242047e58738fa7de1c5a6e5/roles/5756384fa8d842139e2f1fc44c5088bd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:03.638470 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd58b3-d2e2-40a2-9fa3-b6f857a14acd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:03.706207 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:03.717787 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c3e31-9b66-420c-ad40-2a6adf20d3d3 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:03.756088 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60ebba-d39c-43f0-914d-43152ce33720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:03.756729 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60ebba-d39c-43f0-914d-43152ce33720 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:03.757051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60ebba-d39c-43f0-914d-43152ce33720 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:03.757302 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60ebba-d39c-43f0-914d-43152ce33720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:03.758086 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60ebba-d39c-43f0-914d-43152ce33720 None admin] RBAC: Adding query filter params (role.id=9e1823c929634538b474878b5a80c62d, scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5, user.id=55693debeb944df28bd1453ad9955124) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:03.758399 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60ebba-d39c-43f0-914d-43152ce33720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:03.759915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60ebba-d39c-43f0-914d-43152ce33720 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:03.766351 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 118/231] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:03 2022] GET /identity/v3/role_assignments?user.id=55693debeb944df28bd1453ad9955124&scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5&role.id=9e1823c929634538b474878b5a80c62d => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:03.778318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd58b3-d2e2-40a2-9fa3-b6f857a14acd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:03.819891 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c45f0-7cd4-48ae-b5a9-02e698941a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:03.820952 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c45f0-7cd4-48ae-b5a9-02e698941a62 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:03.821456 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c45f0-7cd4-48ae-b5a9-02e698941a62 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:03.821933 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c45f0-7cd4-48ae-b5a9-02e698941a62 None admin] PATH_INFO: `/v3/users/83d0e55a242047e58738fa7de1c5a6e5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:03.823490 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c45f0-7cd4-48ae-b5a9-02e698941a62 None admin] RBAC: Authorizing `identity:get_user(user_id=83d0e55a242047e58738fa7de1c5a6e5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:03.825227 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c45f0-7cd4-48ae-b5a9-02e698941a62 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:03.827182 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 114/232] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:03 2022] GET /identity/v3/users/83d0e55a242047e58738fa7de1c5a6e5 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:03.833587 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60ebba-d39c-43f0-914d-43152ce33720 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:03.917102 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:03.955784 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60ebba-d39c-43f0-914d-43152ce33720 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:03.993616 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1edbb-8a61-4481-9c1a-7a8d87e66363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:03.994616 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1edbb-8a61-4481-9c1a-7a8d87e66363 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:03.995110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1edbb-8a61-4481-9c1a-7a8d87e66363 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:03.995593 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1edbb-8a61-4481-9c1a-7a8d87e66363 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:03.996982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1edbb-8a61-4481-9c1a-7a8d87e66363 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:03.998695 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1edbb-8a61-4481-9c1a-7a8d87e66363 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:04.000639 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 119/233] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:03 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:04.007243 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c45f0-7cd4-48ae-b5a9-02e698941a62 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:04.119259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c45f0-7cd4-48ae-b5a9-02e698941a62 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:04.141845 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:04.169553 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dc08e-f8b4-47bc-b36c-8a7bc4247139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:04.170254 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dc08e-f8b4-47bc-b36c-8a7bc4247139 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:04.170533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dc08e-f8b4-47bc-b36c-8a7bc4247139 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:04.170806 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dc08e-f8b4-47bc-b36c-8a7bc4247139 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5/users/83d0e55a242047e58738fa7de1c5a6e5/roles/d742fa5aed224c11a39ece1d5178d3ca` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:04.178814 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dc08e-f8b4-47bc-b36c-8a7bc4247139 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e0550c0f8641509cb6701c49c8e0f5, user_id=83d0e55a242047e58738fa7de1c5a6e5, role_id=d742fa5aed224c11a39ece1d5178d3ca)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:04.180303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dc08e-f8b4-47bc-b36c-8a7bc4247139 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:04.202475 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 115/234] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:10:04 2022] PUT /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5/users/83d0e55a242047e58738fa7de1c5a6e5/roles/d742fa5aed224c11a39ece1d5178d3ca => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:05.318361 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965db8d-0d1d-4606-a713-fd2b99042918 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:05.319378 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965db8d-0d1d-4606-a713-fd2b99042918 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:05.319855 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965db8d-0d1d-4606-a713-fd2b99042918 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:05.321405 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 120/235] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:05.327026 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549441f-35ab-4f34-a7fa-d436471d7c09 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:05.327831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549441f-35ab-4f34-a7fa-d436471d7c09 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:05.328294 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549441f-35ab-4f34-a7fa-d436471d7c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:05.346634 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-7549441f-35ab-4f34-a7fa-d436471d7c09 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:05.348245 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-7549441f-35ab-4f34-a7fa-d436471d7c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:05.415265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 116/236] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:05.743743 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965db8d-0d1d-4606-a713-fd2b99042918 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:05.857643 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965db8d-0d1d-4606-a713-fd2b99042918 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:05.893571 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc2d3a-34ab-44cc-88ec-522e216a3b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:05.894635 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc2d3a-34ab-44cc-88ec-522e216a3b7e None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:05.895128 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc2d3a-34ab-44cc-88ec-522e216a3b7e None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:05.895655 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc2d3a-34ab-44cc-88ec-522e216a3b7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:05.896948 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc2d3a-34ab-44cc-88ec-522e216a3b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:05.898616 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc2d3a-34ab-44cc-88ec-522e216a3b7e None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:05.903517 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 121/237] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:05.907236 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549441f-35ab-4f34-a7fa-d436471d7c09 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:05.971525 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd5f7a-6600-42a2-9121-02aa88b8e9f7 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:05.972088 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd5f7a-6600-42a2-9121-02aa88b8e9f7 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:05.972580 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd5f7a-6600-42a2-9121-02aa88b8e9f7 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:05.974156 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 122/238] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:05.983207 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b83b0c-bb0d-427c-9bbb-d85feea61a61 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:05.983741 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b83b0c-bb0d-427c-9bbb-d85feea61a61 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:05.984177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b83b0c-bb0d-427c-9bbb-d85feea61a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:05.997693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:06.010728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-15b83b0c-bb0d-427c-9bbb-d85feea61a61 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:06.013506 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-15b83b0c-bb0d-427c-9bbb-d85feea61a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:06.099432 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549441f-35ab-4f34-a7fa-d436471d7c09 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:06.114235 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:06.150324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 123/239] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:06.161000 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87ffb2-0921-4a54-9e59-669533bc4712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:06.161718 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87ffb2-0921-4a54-9e59-669533bc4712 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:06.162021 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87ffb2-0921-4a54-9e59-669533bc4712 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:06.162282 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87ffb2-0921-4a54-9e59-669533bc4712 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:06.162936 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87ffb2-0921-4a54-9e59-669533bc4712 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:06.164410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87ffb2-0921-4a54-9e59-669533bc4712 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:06.192121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 117/240] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 23 16:10:05 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:10:06.456046 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5673a-d2cc-43bf-9d84-7ee67503e332 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:06.456592 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5673a-d2cc-43bf-9d84-7ee67503e332 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:06.456592 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5673a-d2cc-43bf-9d84-7ee67503e332 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:06.458066 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 124/241] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:06.463635 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e61dc-92f4-4453-8d06-66e67940d631 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:06.464057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e61dc-92f4-4453-8d06-66e67940d631 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:06.464243 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e61dc-92f4-4453-8d06-66e67940d631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:06.488043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b21e61dc-92f4-4453-8d06-66e67940d631 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:06.489297 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b21e61dc-92f4-4453-8d06-66e67940d631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:06.492050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2b905-9df4-49dd-b617-91d9f93b6552 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:06.492330 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2b905-9df4-49dd-b617-91d9f93b6552 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:06.492603 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2b905-9df4-49dd-b617-91d9f93b6552 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:06.493946 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 125/242] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:06.500078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf0847-1914-4395-9ac9-7d91883a13f4 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:06.500356 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf0847-1914-4395-9ac9-7d91883a13f4 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:06.500623 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf0847-1914-4395-9ac9-7d91883a13f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:06.521676 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-21bf0847-1914-4395-9ac9-7d91883a13f4 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:06.522909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-21bf0847-1914-4395-9ac9-7d91883a13f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:06.594518 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 118/243] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:06.595586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e61dc-92f4-4453-8d06-66e67940d631 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:06.618035 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 126/244] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:06.700596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:06.707587 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e61dc-92f4-4453-8d06-66e67940d631 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:06.749067 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc830511-d478-4dd6-aa3a-59a408bf4f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:06.749708 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc830511-d478-4dd6-aa3a-59a408bf4f72 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:06.749978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc830511-d478-4dd6-aa3a-59a408bf4f72 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:06.750273 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc830511-d478-4dd6-aa3a-59a408bf4f72 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:06.763321 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc830511-d478-4dd6-aa3a-59a408bf4f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-cc830511-d478-4dd6-aa3a-59a408bf4f72 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:06.771834 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:06.772753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:06.773543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 119/245] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:06.780504 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf0847-1914-4395-9ac9-7d91883a13f4 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:06.857516 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:06.900057 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf0847-1914-4395-9ac9-7d91883a13f4 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:06.944697 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c19920-d7ba-4142-8f3d-9ca1bcfb3baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:06.945368 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c19920-d7ba-4142-8f3d-9ca1bcfb3baf None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:06.945643 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c19920-d7ba-4142-8f3d-9ca1bcfb3baf None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:06.945908 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c19920-d7ba-4142-8f3d-9ca1bcfb3baf None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:06.946673 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c19920-d7ba-4142-8f3d-9ca1bcfb3baf None admin] RBAC: Adding query filter params (name=reader) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:06.946967 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c19920-d7ba-4142-8f3d-9ca1bcfb3baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:06.948346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c19920-d7ba-4142-8f3d-9ca1bcfb3baf None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:06.959558 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 127/246] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:06.965317 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc830511-d478-4dd6-aa3a-59a408bf4f72 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:06.976908 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c19920-d7ba-4142-8f3d-9ca1bcfb3baf None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:07.087654 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc830511-d478-4dd6-aa3a-59a408bf4f72 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:07.110993 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c19920-d7ba-4142-8f3d-9ca1bcfb3baf None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:07.128001 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101f75d-a1d0-473c-b074-3124d184277f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:07.128633 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101f75d-a1d0-473c-b074-3124d184277f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:07.128906 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101f75d-a1d0-473c-b074-3124d184277f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:07.129170 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101f75d-a1d0-473c-b074-3124d184277f None admin] PATH_INFO: `/v3/users/edb97eee1b724a3db6bedae55332e081` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:07.139911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:07.145755 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101f75d-a1d0-473c-b074-3124d184277f None admin] RBAC: Authorizing `identity:get_user(user_id=edb97eee1b724a3db6bedae55332e081)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:07.147280 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101f75d-a1d0-473c-b074-3124d184277f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:07.148097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257952b-551e-4a32-a6c0-358daa04be03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:07.148742 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257952b-551e-4a32-a6c0-358daa04be03 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:07.148950 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 120/247] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:06 2022] GET /identity/v3/users/edb97eee1b724a3db6bedae55332e081 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:07.149191 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257952b-551e-4a32-a6c0-358daa04be03 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:07.149343 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257952b-551e-4a32-a6c0-358daa04be03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:07.149709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101f75d-a1d0-473c-b074-3124d184277f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:07.165695 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257952b-551e-4a32-a6c0-358daa04be03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-6257952b-551e-4a32-a6c0-358daa04be03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:07.172992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:07.175237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 128/248] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:10:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:07.177117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0108b7-8d15-40b2-acea-8389cdd2a4f4 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:07.178897 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0108b7-8d15-40b2-acea-8389cdd2a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:07.178897 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0108b7-8d15-40b2-acea-8389cdd2a4f4 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:07.178897 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 129/249] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:07.178897 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0108b7-8d15-40b2-acea-8389cdd2a4f4 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:07.183234 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:07.284097 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101f75d-a1d0-473c-b074-3124d184277f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:07.308695 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0108b7-8d15-40b2-acea-8389cdd2a4f4 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:07.327221 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bcce6-cabc-4b75-a237-205ab3f6546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:07.328127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bcce6-cabc-4b75-a237-205ab3f6546e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:07.328403 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bcce6-cabc-4b75-a237-205ab3f6546e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:07.328672 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bcce6-cabc-4b75-a237-205ab3f6546e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:07.341938 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bcce6-cabc-4b75-a237-205ab3f6546e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-eb9bcce6-cabc-4b75-a237-205ab3f6546e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:07.348503 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:07.350220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:07.352184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:07.352184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:07.352184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:07.352184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:07.352184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:07.352184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:07.352184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:07.352184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:07.352184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:07.352184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:07.352184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:07.352184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:07.353609 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548c427-4233-4fcb-81e8-8c344e49cb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:07.353769 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 121/250] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:07.353918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548c427-4233-4fcb-81e8-8c344e49cb6e None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:07.358615 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3613b-3d3b-4b94-b8e6-4e82bb5a30e9 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:07.358833 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548c427-4233-4fcb-81e8-8c344e49cb6e None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:07.358987 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3613b-3d3b-4b94-b8e6-4e82bb5a30e9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:07.359129 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548c427-4233-4fcb-81e8-8c344e49cb6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:07.359221 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3613b-3d3b-4b94-b8e6-4e82bb5a30e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:07.372851 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-c2b3613b-3d3b-4b94-b8e6-4e82bb5a30e9 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:07.374063 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-c2b3613b-3d3b-4b94-b8e6-4e82bb5a30e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:07.416387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:07.431181 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548c427-4233-4fcb-81e8-8c344e49cb6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:07.432873 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548c427-4233-4fcb-81e8-8c344e49cb6e None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:07.444749 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 122/251] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:07.445664 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3613b-3d3b-4b94-b8e6-4e82bb5a30e9 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:07.447879 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:07.548177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 130/252] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:07.549661 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548c427-4233-4fcb-81e8-8c344e49cb6e None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:07.562856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3613b-3d3b-4b94-b8e6-4e82bb5a30e9 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:07.597720 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d678018-1941-4f16-ba5b-58e5e987fa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:07.598379 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d678018-1941-4f16-ba5b-58e5e987fa12 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:07.598649 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d678018-1941-4f16-ba5b-58e5e987fa12 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:07.598969 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d678018-1941-4f16-ba5b-58e5e987fa12 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:07.599634 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d678018-1941-4f16-ba5b-58e5e987fa12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:07.599931 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d678018-1941-4f16-ba5b-58e5e987fa12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:07.601305 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d678018-1941-4f16-ba5b-58e5e987fa12 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:07.610328 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 123/253] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:07.611028 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d678018-1941-4f16-ba5b-58e5e987fa12 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:07.649246 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:07.662821 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548c427-4233-4fcb-81e8-8c344e49cb6e None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:07.678258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:07.699793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0f1aa-32de-4bea-abf1-acf93691c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:07.700753 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0f1aa-32de-4bea-abf1-acf93691c3a5 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:07.701260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0f1aa-32de-4bea-abf1-acf93691c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:07.701731 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0f1aa-32de-4bea-abf1-acf93691c3a5 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:07.702654 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0f1aa-32de-4bea-abf1-acf93691c3a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:07.703153 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0f1aa-32de-4bea-abf1-acf93691c3a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:07.704891 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0f1aa-32de-4bea-abf1-acf93691c3a5 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:07.713606 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 131/254] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:07.714753 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0f1aa-32de-4bea-abf1-acf93691c3a5 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:07.719679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d678018-1941-4f16-ba5b-58e5e987fa12 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:07.755988 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06639a-644f-4cb4-acfe-7206aac0e742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:07.756707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06639a-644f-4cb4-acfe-7206aac0e742 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:07.756967 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06639a-644f-4cb4-acfe-7206aac0e742 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:07.757235 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06639a-644f-4cb4-acfe-7206aac0e742 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:07.758424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06639a-644f-4cb4-acfe-7206aac0e742 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:07.759981 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06639a-644f-4cb4-acfe-7206aac0e742 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:07.761735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 124/255] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:07 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:07.762512 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06639a-644f-4cb4-acfe-7206aac0e742 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:07.821167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0f1aa-32de-4bea-abf1-acf93691c3a5 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:07.855940 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c6e11-5f74-43dd-a771-5ef074837cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:07.856921 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c6e11-5f74-43dd-a771-5ef074837cb3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:07.857395 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c6e11-5f74-43dd-a771-5ef074837cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:07.857859 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c6e11-5f74-43dd-a771-5ef074837cb3 None admin] PATH_INFO: `/v3/users/83d0e55a242047e58738fa7de1c5a6e5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:07.859203 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c6e11-5f74-43dd-a771-5ef074837cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=83d0e55a242047e58738fa7de1c5a6e5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:07.860952 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c6e11-5f74-43dd-a771-5ef074837cb3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:07.862876 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 132/256] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:07 2022] GET /identity/v3/users/83d0e55a242047e58738fa7de1c5a6e5 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:07.863845 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c6e11-5f74-43dd-a771-5ef074837cb3 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:07.869055 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06639a-644f-4cb4-acfe-7206aac0e742 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:07.888763 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:07.922938 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:07.930814 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7724843-68c6-4f40-bb68-48e0a6d4026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:07.932318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7724843-68c6-4f40-bb68-48e0a6d4026e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:07.932608 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7724843-68c6-4f40-bb68-48e0a6d4026e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:07.932877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7724843-68c6-4f40-bb68-48e0a6d4026e None admin] PATH_INFO: `/v3/users/55693debeb944df28bd1453ad9955124` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:07.938685 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7724843-68c6-4f40-bb68-48e0a6d4026e None admin] RBAC: Authorizing `identity:get_user(user_id=55693debeb944df28bd1453ad9955124)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:07.940149 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7724843-68c6-4f40-bb68-48e0a6d4026e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:07.942333 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 125/257] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:07 2022] GET /identity/v3/users/55693debeb944df28bd1453ad9955124 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:07.943181 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7724843-68c6-4f40-bb68-48e0a6d4026e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:07.985176 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c6e11-5f74-43dd-a771-5ef074837cb3 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:08.021921 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83969599-d64a-47d8-bf82-8098893e7dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:08.022969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83969599-d64a-47d8-bf82-8098893e7dec None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:08.023443 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83969599-d64a-47d8-bf82-8098893e7dec None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:08.024038 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83969599-d64a-47d8-bf82-8098893e7dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:08.025028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83969599-d64a-47d8-bf82-8098893e7dec None admin] RBAC: Adding query filter params (role.id=f0d638fc9d904725ae87d968c84512df, scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5, user.id=edb97eee1b724a3db6bedae55332e081) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:08.025641 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83969599-d64a-47d8-bf82-8098893e7dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:08.027838 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83969599-d64a-47d8-bf82-8098893e7dec None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:08.035368 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 133/258] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:07 2022] GET /identity/v3/role_assignments?user.id=edb97eee1b724a3db6bedae55332e081&scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5&role.id=f0d638fc9d904725ae87d968c84512df => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:08.036664 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83969599-d64a-47d8-bf82-8098893e7dec None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:08.133589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:08.160327 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7724843-68c6-4f40-bb68-48e0a6d4026e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:08.164329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83969599-d64a-47d8-bf82-8098893e7dec None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:08.202467 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153e953-fda3-4025-ab49-d6e46805b7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:08.203421 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153e953-fda3-4025-ab49-d6e46805b7ee None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:08.203874 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153e953-fda3-4025-ab49-d6e46805b7ee None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:08.204525 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153e953-fda3-4025-ab49-d6e46805b7ee None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:08.205946 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153e953-fda3-4025-ab49-d6e46805b7ee None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:08.207660 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153e953-fda3-4025-ab49-d6e46805b7ee None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:08.209669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 134/259] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:08 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:08.210684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153e953-fda3-4025-ab49-d6e46805b7ee None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:08.235057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d06bf5-dcc5-4c32-a1ea-9ac907983156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:08.235394 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d06bf5-dcc5-4c32-a1ea-9ac907983156 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:08.235672 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d06bf5-dcc5-4c32-a1ea-9ac907983156 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:08.235939 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d06bf5-dcc5-4c32-a1ea-9ac907983156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:08.318789 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153e953-fda3-4025-ab49-d6e46805b7ee None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:08.354789 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92937b-7049-413f-8ccb-1ee6f204e080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:08.355794 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92937b-7049-413f-8ccb-1ee6f204e080 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:08.356267 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92937b-7049-413f-8ccb-1ee6f204e080 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:08.356730 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92937b-7049-413f-8ccb-1ee6f204e080 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:08.367972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92937b-7049-413f-8ccb-1ee6f204e080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-dd92937b-7049-413f-8ccb-1ee6f204e080 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:08.373733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:08.374627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:08.375420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:08.375420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:08.375420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:08.375420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:08.375420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:08.375420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:08.375420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:08.375420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:08.375420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:08.375420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:08.375420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:08.375420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:08.377941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 135/260] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:10:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:08.378992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92937b-7049-413f-8ccb-1ee6f204e080 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:08.386223 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:08.398776 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d06bf5-dcc5-4c32-a1ea-9ac907983156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:08.400282 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d06bf5-dcc5-4c32-a1ea-9ac907983156 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:08.402635 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:08.485411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92937b-7049-413f-8ccb-1ee6f204e080 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:08.531578 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e159005-54d5-4035-82ca-d7231310f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:08.534173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e159005-54d5-4035-82ca-d7231310f0ff None admin] REQUEST_METHOD: `PUT` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:08.534658 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e159005-54d5-4035-82ca-d7231310f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:08.535127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e159005-54d5-4035-82ca-d7231310f0ff None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5/users/55693debeb944df28bd1453ad9955124/roles/9e1823c929634538b474878b5a80c62d` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:08.539477 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e159005-54d5-4035-82ca-d7231310f0ff None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e0550c0f8641509cb6701c49c8e0f5, user_id=55693debeb944df28bd1453ad9955124, role_id=9e1823c929634538b474878b5a80c62d)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:08.540966 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e159005-54d5-4035-82ca-d7231310f0ff None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:08.572142 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 136/261] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:10:08 2022] PUT /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5/users/55693debeb944df28bd1453ad9955124/roles/9e1823c929634538b474878b5a80c62d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:08.575593 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e159005-54d5-4035-82ca-d7231310f0ff None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:08.579484 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 126/262] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:08.585573 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d06bf5-dcc5-4c32-a1ea-9ac907983156 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:08.723202 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:08.740644 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:08.744725 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d06bf5-dcc5-4c32-a1ea-9ac907983156 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:08.780397 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e159005-54d5-4035-82ca-d7231310f0ff None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:08.803639 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6994ae-19ac-4379-a49f-ce0dea157c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:08.805888 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6994ae-19ac-4379-a49f-ce0dea157c41 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:08.806591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6994ae-19ac-4379-a49f-ce0dea157c41 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:08.807523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6994ae-19ac-4379-a49f-ce0dea157c41 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:08.808991 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6994ae-19ac-4379-a49f-ce0dea157c41 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:08.810919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6994ae-19ac-4379-a49f-ce0dea157c41 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:08.813547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 127/263] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:08 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:08.819807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6994ae-19ac-4379-a49f-ce0dea157c41 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:08.851019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e39ce-41fc-4b15-a0d8-1e079f92de68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:08.851642 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e39ce-41fc-4b15-a0d8-1e079f92de68 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:08.851925 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e39ce-41fc-4b15-a0d8-1e079f92de68 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:08.852194 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e39ce-41fc-4b15-a0d8-1e079f92de68 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:08.852862 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e39ce-41fc-4b15-a0d8-1e079f92de68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:08.853161 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e39ce-41fc-4b15-a0d8-1e079f92de68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:08.858976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e39ce-41fc-4b15-a0d8-1e079f92de68 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:08.872143 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 137/264] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:08.877887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e39ce-41fc-4b15-a0d8-1e079f92de68 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:09.006360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6994ae-19ac-4379-a49f-ce0dea157c41 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:09.020151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e39ce-41fc-4b15-a0d8-1e079f92de68 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:09.052714 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:09.059067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbaab1-4f35-463e-a147-233f3e7f8a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:09.060082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbaab1-4f35-463e-a147-233f3e7f8a7f None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:09.060576 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbaab1-4f35-463e-a147-233f3e7f8a7f None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:09.061105 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbaab1-4f35-463e-a147-233f3e7f8a7f None admin] PATH_INFO: `/v3/users/83d0e55a242047e58738fa7de1c5a6e5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:09.062519 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbaab1-4f35-463e-a147-233f3e7f8a7f None admin] RBAC: Authorizing `identity:get_user(user_id=83d0e55a242047e58738fa7de1c5a6e5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:09.064288 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbaab1-4f35-463e-a147-233f3e7f8a7f None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:09.066630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 138/265] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:08 2022] GET /identity/v3/users/83d0e55a242047e58738fa7de1c5a6e5 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:09.072790 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbaab1-4f35-463e-a147-233f3e7f8a7f None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:09.079941 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5e5d4-8de5-4017-be77-249aec9b492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:09.080564 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5e5d4-8de5-4017-be77-249aec9b492b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:09.080837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5e5d4-8de5-4017-be77-249aec9b492b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:09.081104 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5e5d4-8de5-4017-be77-249aec9b492b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:09.081843 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5e5d4-8de5-4017-be77-249aec9b492b None admin] RBAC: Adding query filter params (role.id=5756384fa8d842139e2f1fc44c5088bd, scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5, user.id=83d0e55a242047e58738fa7de1c5a6e5) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:09.082176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5e5d4-8de5-4017-be77-249aec9b492b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:09.083700 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5e5d4-8de5-4017-be77-249aec9b492b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:09.102612 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 128/266] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:08 2022] GET /identity/v3/role_assignments?user.id=83d0e55a242047e58738fa7de1c5a6e5&scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5&role.id=5756384fa8d842139e2f1fc44c5088bd => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:09.187345 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbaab1-4f35-463e-a147-233f3e7f8a7f None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:09.224926 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf4336-ef44-477f-9363-a497c4a6f4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:09.225964 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf4336-ef44-477f-9363-a497c4a6f4a7 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:09.226514 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf4336-ef44-477f-9363-a497c4a6f4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:09.226977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf4336-ef44-477f-9363-a497c4a6f4a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:09.298818 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:09.306389 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf4336-ef44-477f-9363-a497c4a6f4a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:09.308237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf4336-ef44-477f-9363-a497c4a6f4a7 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:09.421138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 139/267] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:09.427201 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5e5d4-8de5-4017-be77-249aec9b492b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:09.481042 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:09.575180 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5e5d4-8de5-4017-be77-249aec9b492b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:09.614297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274288e3-e499-41da-bd80-e9a18f23100f None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:09.614881 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274288e3-e499-41da-bd80-e9a18f23100f None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:09.615121 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274288e3-e499-41da-bd80-e9a18f23100f None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:09.616977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 140/268] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:09.617719 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a927d30-36cb-4610-829c-5a5768f8321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:09.618435 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a927d30-36cb-4610-829c-5a5768f8321e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:09.618714 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a927d30-36cb-4610-829c-5a5768f8321e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:09.618983 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a927d30-36cb-4610-829c-5a5768f8321e None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:09.624702 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a927d30-36cb-4610-829c-5a5768f8321e None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:09.625771 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ed3e4-a5b5-4092-a821-4c26b2e9bbea None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:09.628437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a927d30-36cb-4610-829c-5a5768f8321e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:09.628437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 129/269] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:09 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:09.629365 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ed3e4-a5b5-4092-a821-4c26b2e9bbea None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:09.630294 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ed3e4-a5b5-4092-a821-4c26b2e9bbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:09.634768 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a927d30-36cb-4610-829c-5a5768f8321e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:09.666778 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-8e9ed3e4-a5b5-4092-a821-4c26b2e9bbea None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:09.669439 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-8e9ed3e4-a5b5-4092-a821-4c26b2e9bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:09.758405 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:09.762298 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a927d30-36cb-4610-829c-5a5768f8321e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:09.798042 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 141/270] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:09.798993 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287aa8b-93cd-40ee-b273-ed6b5fc842ee None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:09.799280 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287aa8b-93cd-40ee-b273-ed6b5fc842ee None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:09.799547 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287aa8b-93cd-40ee-b273-ed6b5fc842ee None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:09.800844 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 142/271] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:09.810476 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d11c07-a88d-4089-a1bd-cc124401cfd4 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:09.810601 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3922a14-dfb1-4019-b5d9-fa42c351f014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:09.810790 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d11c07-a88d-4089-a1bd-cc124401cfd4 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:09.811082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d11c07-a88d-4089-a1bd-cc124401cfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:09.811178 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922a14-dfb1-4019-b5d9-fa42c351f014 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:09.811427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922a14-dfb1-4019-b5d9-fa42c351f014 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:09.811693 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922a14-dfb1-4019-b5d9-fa42c351f014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:09.812465 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3922a14-dfb1-4019-b5d9-fa42c351f014 None admin] RBAC: Adding query filter params (role.id=d742fa5aed224c11a39ece1d5178d3ca, scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5, user.id=83d0e55a242047e58738fa7de1c5a6e5) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:09.812818 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3922a14-dfb1-4019-b5d9-fa42c351f014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:09.814290 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3922a14-dfb1-4019-b5d9-fa42c351f014 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:09.820817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 130/272] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:09 2022] GET /identity/v3/role_assignments?user.id=83d0e55a242047e58738fa7de1c5a6e5&scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5&role.id=d742fa5aed224c11a39ece1d5178d3ca => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:09.851383 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-c0d11c07-a88d-4089-a1bd-cc124401cfd4 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:09.852547 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-c0d11c07-a88d-4089-a1bd-cc124401cfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:09.890407 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:09.955552 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 143/273] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:10.142084 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3922a14-dfb1-4019-b5d9-fa42c351f014 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:10.259773 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3922a14-dfb1-4019-b5d9-fa42c351f014 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:10.309905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e7c3f-4825-4e10-9f17-defe5e6364b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:10.311292 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e7c3f-4825-4e10-9f17-defe5e6364b8 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:10.311748 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e7c3f-4825-4e10-9f17-defe5e6364b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:10.312190 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e7c3f-4825-4e10-9f17-defe5e6364b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:10.313973 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e7c3f-4825-4e10-9f17-defe5e6364b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:10.315969 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e7c3f-4825-4e10-9f17-defe5e6364b8 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:10.317840 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 131/274] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:10.324326 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d11c07-a88d-4089-a1bd-cc124401cfd4 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:10.383922 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e7c3f-4825-4e10-9f17-defe5e6364b8 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:10.426303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:10.469487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d11c07-a88d-4089-a1bd-cc124401cfd4 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:10.500852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e7c3f-4825-4e10-9f17-defe5e6364b8 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:10.509106 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6e2c9-c04d-4f78-b13b-13853a70750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:10.510079 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6e2c9-c04d-4f78-b13b-13853a70750d None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:10.510594 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6e2c9-c04d-4f78-b13b-13853a70750d None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:10.511053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6e2c9-c04d-4f78-b13b-13853a70750d None admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:10.511901 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6e2c9-c04d-4f78-b13b-13853a70750d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:10.513544 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6e2c9-c04d-4f78-b13b-13853a70750d None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:10.538872 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4adad3-4298-45a3-8f5b-32fc823f8fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:10.539609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4adad3-4298-45a3-8f5b-32fc823f8fb9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:10.539954 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4adad3-4298-45a3-8f5b-32fc823f8fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:10.540218 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4adad3-4298-45a3-8f5b-32fc823f8fb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:10.550531 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 144/275] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 23 16:10:10 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:10:10.560496 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4adad3-4298-45a3-8f5b-32fc823f8fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-dd4adad3-4298-45a3-8f5b-32fc823f8fb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:10.566053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:10.567010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:10.567860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 132/276] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:10:10.575704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6e2c9-c04d-4f78-b13b-13853a70750d None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:10.598621 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:10.705689 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6e2c9-c04d-4f78-b13b-13853a70750d None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:10.743567 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b059116-87cd-46ea-82e3-4416a78e4808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:10.744205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b059116-87cd-46ea-82e3-4416a78e4808 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:10.744475 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b059116-87cd-46ea-82e3-4416a78e4808 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:10.744739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b059116-87cd-46ea-82e3-4416a78e4808 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:10.745413 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b059116-87cd-46ea-82e3-4416a78e4808 None admin] RBAC: Adding query filter params (name=member) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:10.745708 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b059116-87cd-46ea-82e3-4416a78e4808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:10.747196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b059116-87cd-46ea-82e3-4416a78e4808 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:10.757540 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 145/277] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:10.764311 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4adad3-4298-45a3-8f5b-32fc823f8fb9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:10.857913 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595b54-bd60-400c-9618-ba6d61c4a6dc None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:10.859195 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595b54-bd60-400c-9618-ba6d61c4a6dc None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:10.859479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595b54-bd60-400c-9618-ba6d61c4a6dc None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:10.861078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 146/278] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:10.866674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8676fb-2799-462e-9b98-cb607b1c110a None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:10.866948 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8676fb-2799-462e-9b98-cb607b1c110a None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:10.867217 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8676fb-2799-462e-9b98-cb607b1c110a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:10.873955 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:10.887652 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4adad3-4298-45a3-8f5b-32fc823f8fb9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:10.897329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-4a8676fb-2799-462e-9b98-cb607b1c110a None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:10.899350 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-4a8676fb-2799-462e-9b98-cb607b1c110a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:10.932877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286bd0a-ceff-473e-8456-27274b6ebabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:10.933882 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286bd0a-ceff-473e-8456-27274b6ebabb None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:10.934336 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286bd0a-ceff-473e-8456-27274b6ebabb None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:10.934739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286bd0a-ceff-473e-8456-27274b6ebabb None admin] PATH_INFO: `/v3/users/89144156f2ba46ec9dc7871748244329` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:10.954217 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286bd0a-ceff-473e-8456-27274b6ebabb None admin] RBAC: Authorizing `identity:get_user(user_id=89144156f2ba46ec9dc7871748244329)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:10.956187 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286bd0a-ceff-473e-8456-27274b6ebabb None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:10.958587 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 133/279] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:10 2022] GET /identity/v3/users/89144156f2ba46ec9dc7871748244329 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:10.969694 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286bd0a-ceff-473e-8456-27274b6ebabb None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:10.996865 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 147/280] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:11.098489 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286bd0a-ceff-473e-8456-27274b6ebabb None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:11.136387 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461a881-d62f-4a90-a409-912deaabb7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:11.136995 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461a881-d62f-4a90-a409-912deaabb7f4 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:11.137266 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461a881-d62f-4a90-a409-912deaabb7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:11.137531 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461a881-d62f-4a90-a409-912deaabb7f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:11.138286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461a881-d62f-4a90-a409-912deaabb7f4 None admin] RBAC: Adding query filter params (role.id=9e1823c929634538b474878b5a80c62d, user.id=89144156f2ba46ec9dc7871748244329, scope.system=all) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:11.138649 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461a881-d62f-4a90-a409-912deaabb7f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:11.140134 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461a881-d62f-4a90-a409-912deaabb7f4 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:11.146379 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 134/281] 10.222.0.47 () {56 vars in 1308 bytes} [Tue Aug 23 16:10:10 2022] GET /identity/v3/role_assignments?user.id=89144156f2ba46ec9dc7871748244329&scope.system=all&role.id=9e1823c929634538b474878b5a80c62d => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:11.403746 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8676fb-2799-462e-9b98-cb607b1c110a None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:11.415385 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:11.526523 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8676fb-2799-462e-9b98-cb607b1c110a None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:11.568055 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237cd85-f447-453d-bff4-dcb7a0c18dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:11.568997 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237cd85-f447-453d-bff4-dcb7a0c18dbc None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:11.569438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237cd85-f447-453d-bff4-dcb7a0c18dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:11.569867 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237cd85-f447-453d-bff4-dcb7a0c18dbc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:11.587220 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237cd85-f447-453d-bff4-dcb7a0c18dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-0237cd85-f447-453d-bff4-dcb7a0c18dbc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:11.592297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:11.593144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:11.593949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:11.593949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:11.593949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:11.593949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:11.593949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:11.593949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:11.593949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:11.593949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:11.593949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:11.593949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:11.593949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:10:11.593949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:11.596218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 148/282] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:11.601738 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461a881-d62f-4a90-a409-912deaabb7f4 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:11.620528 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:11.724334 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461a881-d62f-4a90-a409-912deaabb7f4 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:11.771686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9893e7-8db7-46d9-945e-b2cce94319c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:11.772328 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9893e7-8db7-46d9-945e-b2cce94319c2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:11.772557 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9893e7-8db7-46d9-945e-b2cce94319c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:11.772820 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9893e7-8db7-46d9-945e-b2cce94319c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:11.773484 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9893e7-8db7-46d9-945e-b2cce94319c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:11.773779 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9893e7-8db7-46d9-945e-b2cce94319c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:11.775190 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9893e7-8db7-46d9-945e-b2cce94319c2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:11.789586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 135/283] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:11.795411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237cd85-f447-453d-bff4-dcb7a0c18dbc None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:11.874378 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:11.915952 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568dbb-a7aa-46a7-a961-7fc708e8064a None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:11.916274 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568dbb-a7aa-46a7-a961-7fc708e8064a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:11.916494 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568dbb-a7aa-46a7-a961-7fc708e8064a None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:11.917949 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 136/284] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:11.921322 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237cd85-f447-453d-bff4-dcb7a0c18dbc None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:11.934998 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4757e-3f8e-453b-9561-3e7d7d5495d5 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:11.935279 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4757e-3f8e-453b-9561-3e7d7d5495d5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:11.935536 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4757e-3f8e-453b-9561-3e7d7d5495d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:11.959298 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a2a4757e-3f8e-453b-9561-3e7d7d5495d5 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:11.961729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a2a4757e-3f8e-453b-9561-3e7d7d5495d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:11.982249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df0444-121c-402c-b0da-9af1b56f054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:11.982802 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df0444-121c-402c-b0da-9af1b56f054c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:11.983073 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df0444-121c-402c-b0da-9af1b56f054c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:11.983406 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df0444-121c-402c-b0da-9af1b56f054c None admin] PATH_INFO: `/v3/users/edb97eee1b724a3db6bedae55332e081` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:11.984755 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df0444-121c-402c-b0da-9af1b56f054c None admin] RBAC: Authorizing `identity:get_user(user_id=edb97eee1b724a3db6bedae55332e081)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:11.987327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df0444-121c-402c-b0da-9af1b56f054c None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:11.990922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 149/285] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:11 2022] GET /identity/v3/users/edb97eee1b724a3db6bedae55332e081 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:11.996021 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df0444-121c-402c-b0da-9af1b56f054c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:12.101759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 137/286] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:12.149569 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df0444-121c-402c-b0da-9af1b56f054c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:12.192106 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7da25-a4b4-4b8b-9782-158f11dc35ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:12.192807 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7da25-a4b4-4b8b-9782-158f11dc35ae None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:12.193082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7da25-a4b4-4b8b-9782-158f11dc35ae None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:12.193346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7da25-a4b4-4b8b-9782-158f11dc35ae None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:12.194474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7da25-a4b4-4b8b-9782-158f11dc35ae None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:12.195900 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7da25-a4b4-4b8b-9782-158f11dc35ae None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:12.197827 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 150/287] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:11 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:12.204460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4757e-3f8e-453b-9561-3e7d7d5495d5 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:12.213522 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:12.330470 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4757e-3f8e-453b-9561-3e7d7d5495d5 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:12.377041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985696d-bd79-48a4-b99e-47c6c8636070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:12.377700 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985696d-bd79-48a4-b99e-47c6c8636070 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:12.377979 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985696d-bd79-48a4-b99e-47c6c8636070 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:12.378268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985696d-bd79-48a4-b99e-47c6c8636070 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5/users/edb97eee1b724a3db6bedae55332e081/roles/f0d638fc9d904725ae87d968c84512df` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:12.380200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985696d-bd79-48a4-b99e-47c6c8636070 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e0550c0f8641509cb6701c49c8e0f5, user_id=edb97eee1b724a3db6bedae55332e081, role_id=f0d638fc9d904725ae87d968c84512df)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:12.381721 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985696d-bd79-48a4-b99e-47c6c8636070 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:12.410896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 138/288] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:10:12 2022] PUT /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5/users/edb97eee1b724a3db6bedae55332e081/roles/f0d638fc9d904725ae87d968c84512df => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:12.626723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7da25-a4b4-4b8b-9782-158f11dc35ae None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:12.632445 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:12.742688 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7da25-a4b4-4b8b-9782-158f11dc35ae None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:12.782757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc5fd7-4b2a-44cc-90ae-62bb2cd7455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:12.783808 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc5fd7-4b2a-44cc-90ae-62bb2cd7455f None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:12.784314 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc5fd7-4b2a-44cc-90ae-62bb2cd7455f None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:12.784788 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc5fd7-4b2a-44cc-90ae-62bb2cd7455f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:12.799379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc5fd7-4b2a-44cc-90ae-62bb2cd7455f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-92cc5fd7-4b2a-44cc-90ae-62bb2cd7455f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:12.805045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:12.805911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:12.807024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:12.807024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:12.807024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:12.807024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:12.807024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:12.807024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:12.807024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:12.807024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:12.807024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:12.807024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:12.807024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:12.807024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:12.809414 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 151/289] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:12.815499 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985696d-bd79-48a4-b99e-47c6c8636070 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:12.884705 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:12.923469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985696d-bd79-48a4-b99e-47c6c8636070 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:12.967318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce47dd7-c8e0-4c51-bd4f-87bca97fd1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:12.967934 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47dd7-c8e0-4c51-bd4f-87bca97fd1ff None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:12.968204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47dd7-c8e0-4c51-bd4f-87bca97fd1ff None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:12.968474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47dd7-c8e0-4c51-bd4f-87bca97fd1ff None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:12.969192 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce47dd7-c8e0-4c51-bd4f-87bca97fd1ff None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:12.969493 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce47dd7-c8e0-4c51-bd4f-87bca97fd1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:12.970946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce47dd7-c8e0-4c51-bd4f-87bca97fd1ff None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:12.980118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 139/290] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:12.985698 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc5fd7-4b2a-44cc-90ae-62bb2cd7455f None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:13.066985 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:13.120004 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc5fd7-4b2a-44cc-90ae-62bb2cd7455f None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:13.167994 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fd75b-a4ef-4149-96f0-909094946d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:13.168577 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fd75b-a4ef-4149-96f0-909094946d46 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:13.168853 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fd75b-a4ef-4149-96f0-909094946d46 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:13.169132 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fd75b-a4ef-4149-96f0-909094946d46 None admin] PATH_INFO: `/v3/users/55693debeb944df28bd1453ad9955124` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:13.170333 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fd75b-a4ef-4149-96f0-909094946d46 None admin] RBAC: Authorizing `identity:get_user(user_id=55693debeb944df28bd1453ad9955124)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:13.171815 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fd75b-a4ef-4149-96f0-909094946d46 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:13.173780 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 152/291] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:12 2022] GET /identity/v3/users/55693debeb944df28bd1453ad9955124 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:13.179197 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce47dd7-c8e0-4c51-bd4f-87bca97fd1ff None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:13.320450 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce47dd7-c8e0-4c51-bd4f-87bca97fd1ff None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:13.368195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:13.378646 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3271825-7a99-4510-bb22-03dd3e9df397 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:13.378943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3271825-7a99-4510-bb22-03dd3e9df397 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:13.379199 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3271825-7a99-4510-bb22-03dd3e9df397 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:13.380688 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 153/292] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:13.381802 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc8437-a3a5-4701-9c39-f6f82bf64da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:13.381926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc8437-a3a5-4701-9c39-f6f82bf64da5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:13.382228 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc8437-a3a5-4701-9c39-f6f82bf64da5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:13.382496 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc8437-a3a5-4701-9c39-f6f82bf64da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:13.386799 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41587f00-aa51-4f6f-9288-bfc99d331f92 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:13.387287 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41587f00-aa51-4f6f-9288-bfc99d331f92 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:13.387745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41587f00-aa51-4f6f-9288-bfc99d331f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:13.414807 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-41587f00-aa51-4f6f-9288-bfc99d331f92 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:13.417124 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-41587f00-aa51-4f6f-9288-bfc99d331f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:13.525270 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc8437-a3a5-4701-9c39-f6f82bf64da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:13.528209 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc8437-a3a5-4701-9c39-f6f82bf64da5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:13.554820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 154/293] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:13.685466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 140/294] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:13.691266 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41587f00-aa51-4f6f-9288-bfc99d331f92 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:13.763062 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:13.810479 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68b349-5344-480b-8a1a-11213aef89cb None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:13.810787 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68b349-5344-480b-8a1a-11213aef89cb None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:13.811020 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68b349-5344-480b-8a1a-11213aef89cb None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:13.812508 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 141/295] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:13.814020 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41587f00-aa51-4f6f-9288-bfc99d331f92 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:13.817404 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415d46e-1a93-4289-946b-47c486e272b9 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:13.817878 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415d46e-1a93-4289-946b-47c486e272b9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:13.818096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415d46e-1a93-4289-946b-47c486e272b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:13.843684 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-9415d46e-1a93-4289-946b-47c486e272b9 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:13.845065 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-9415d46e-1a93-4289-946b-47c486e272b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:13.850221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559a4ee-a8e1-4299-ae49-a259dd864da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:13.850864 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559a4ee-a8e1-4299-ae49-a259dd864da0 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:13.851135 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559a4ee-a8e1-4299-ae49-a259dd864da0 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:13.851403 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559a4ee-a8e1-4299-ae49-a259dd864da0 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:13.852515 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559a4ee-a8e1-4299-ae49-a259dd864da0 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:13.854137 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559a4ee-a8e1-4299-ae49-a259dd864da0 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:13.855885 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 155/296] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:13 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:13.857102 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedacc92-8cfd-4158-87d8-3b91c2874562 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:13.857381 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedacc92-8cfd-4158-87d8-3b91c2874562 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:13.857647 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedacc92-8cfd-4158-87d8-3b91c2874562 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:13.858965 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 156/297] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:13.863603 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedacc92-8cfd-4158-87d8-3b91c2874562 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:13.877009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:13.918510 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 142/298] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:13.919842 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f414ee6-b301-4d5b-8434-ff37d8071bad None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:13.920123 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f414ee6-b301-4d5b-8434-ff37d8071bad None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:13.920394 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f414ee6-b301-4d5b-8434-ff37d8071bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:13.938575 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-8f414ee6-b301-4d5b-8434-ff37d8071bad None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:13.939758 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-8f414ee6-b301-4d5b-8434-ff37d8071bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:13.976569 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedacc92-8cfd-4158-87d8-3b91c2874562 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:14.007048 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:14.013508 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e9d61-9f5b-4882-82bc-30250c7c1115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:14.014566 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e9d61-9f5b-4882-82bc-30250c7c1115 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:14.015344 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e9d61-9f5b-4882-82bc-30250c7c1115 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:14.015943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e9d61-9f5b-4882-82bc-30250c7c1115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:14.016823 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e9d61-9f5b-4882-82bc-30250c7c1115 None admin] RBAC: Adding query filter params (role.id=9e1823c929634538b474878b5a80c62d, scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5, user.id=55693debeb944df28bd1453ad9955124) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:14.017203 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e9d61-9f5b-4882-82bc-30250c7c1115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:14.018891 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e9d61-9f5b-4882-82bc-30250c7c1115 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:14.019070 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 143/299] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:14.020176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f414ee6-b301-4d5b-8434-ff37d8071bad None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:14.031994 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 157/300] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:13 2022] GET /identity/v3/role_assignments?user.id=55693debeb944df28bd1453ad9955124&scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5&role.id=9e1823c929634538b474878b5a80c62d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:14.146364 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:14.154347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f414ee6-b301-4d5b-8434-ff37d8071bad None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:14.202357 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49431d28-6bee-4580-8dc1-87b2e9156a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:14.203004 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49431d28-6bee-4580-8dc1-87b2e9156a60 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:14.203277 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49431d28-6bee-4580-8dc1-87b2e9156a60 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:14.203542 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49431d28-6bee-4580-8dc1-87b2e9156a60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:14.204655 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49431d28-6bee-4580-8dc1-87b2e9156a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:14.206129 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49431d28-6bee-4580-8dc1-87b2e9156a60 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:14.207727 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 144/301] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:14.216081 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e9d61-9f5b-4882-82bc-30250c7c1115 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:14.279009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49431d28-6bee-4580-8dc1-87b2e9156a60 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:14.320972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e9d61-9f5b-4882-82bc-30250c7c1115 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:14.360380 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811b584-efb6-408c-93e0-f25e034f5ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:14.361024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811b584-efb6-408c-93e0-f25e034f5ee3 None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:14.361302 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811b584-efb6-408c-93e0-f25e034f5ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:14.361569 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811b584-efb6-408c-93e0-f25e034f5ee3 None admin] PATH_INFO: `/v3/groups` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:14.362625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811b584-efb6-408c-93e0-f25e034f5ee3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:14.364330 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811b584-efb6-408c-93e0-f25e034f5ee3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:14.386361 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 158/302] 10.222.0.47 () {60 vars in 1134 bytes} [Tue Aug 23 16:10:14 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:10:14.412766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811b584-efb6-408c-93e0-f25e034f5ee3 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:14.416602 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49431d28-6bee-4580-8dc1-87b2e9156a60 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:14.478461 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac74fa1-6a37-491f-9f23-c974238f6f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:14.479918 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac74fa1-6a37-491f-9f23-c974238f6f11 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:14.480508 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac74fa1-6a37-491f-9f23-c974238f6f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:14.481106 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac74fa1-6a37-491f-9f23-c974238f6f11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:14.491546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:14.505009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac74fa1-6a37-491f-9f23-c974238f6f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-fac74fa1-6a37-491f-9f23-c974238f6f11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:14.510487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:14.511414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:14.512184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 145/303] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:14.519570 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac74fa1-6a37-491f-9f23-c974238f6f11 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:14.549384 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:14.576517 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811b584-efb6-408c-93e0-f25e034f5ee3 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:14.614220 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08318608-bb89-4ad7-bbba-f822a15b677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:14.615172 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318608-bb89-4ad7-bbba-f822a15b677c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:14.615447 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318608-bb89-4ad7-bbba-f822a15b677c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:14.615713 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318608-bb89-4ad7-bbba-f822a15b677c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:14.627056 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08318608-bb89-4ad7-bbba-f822a15b677c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-08318608-bb89-4ad7-bbba-f822a15b677c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:14.632452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:14.633329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:14.634481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 159/304] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:10:14.639645 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08318608-bb89-4ad7-bbba-f822a15b677c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:14.647751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac74fa1-6a37-491f-9f23-c974238f6f11 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:14.690435 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31cc7a-af3c-410c-b038-a92b505528e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:14.691144 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31cc7a-af3c-410c-b038-a92b505528e3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:14.691482 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31cc7a-af3c-410c-b038-a92b505528e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:14.691814 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31cc7a-af3c-410c-b038-a92b505528e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:14.692691 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31cc7a-af3c-410c-b038-a92b505528e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:14.693056 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31cc7a-af3c-410c-b038-a92b505528e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:14.694568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31cc7a-af3c-410c-b038-a92b505528e3 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:14.703869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 146/305] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:14.720424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31cc7a-af3c-410c-b038-a92b505528e3 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:14.765605 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08318608-bb89-4ad7-bbba-f822a15b677c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:14.793674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:14.817259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:14.822020 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f8001-a3a3-4e76-80aa-1c969079ce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:14.823441 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8001-a3a3-4e76-80aa-1c969079ce4c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:14.823916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8001-a3a3-4e76-80aa-1c969079ce4c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:14.824783 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8001-a3a3-4e76-80aa-1c969079ce4c None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:14.826332 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f8001-a3a3-4e76-80aa-1c969079ce4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:14.827408 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f8001-a3a3-4e76-80aa-1c969079ce4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:14.831854 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f8001-a3a3-4e76-80aa-1c969079ce4c None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:14.847152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 160/306] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:14.856138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f8001-a3a3-4e76-80aa-1c969079ce4c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:14.859482 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31cc7a-af3c-410c-b038-a92b505528e3 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:14.918237 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26249c52-e206-4732-8445-1a1bd7327f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:14.918893 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26249c52-e206-4732-8445-1a1bd7327f69 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:14.919168 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26249c52-e206-4732-8445-1a1bd7327f69 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:14.919435 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26249c52-e206-4732-8445-1a1bd7327f69 None admin] PATH_INFO: `/v3/users/89144156f2ba46ec9dc7871748244329` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:14.921163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26249c52-e206-4732-8445-1a1bd7327f69 None admin] RBAC: Authorizing `identity:get_user(user_id=89144156f2ba46ec9dc7871748244329)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:14.922814 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26249c52-e206-4732-8445-1a1bd7327f69 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:14.929579 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 147/307] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:14 2022] GET /identity/v3/users/89144156f2ba46ec9dc7871748244329 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:14.930507 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26249c52-e206-4732-8445-1a1bd7327f69 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:14.981592 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f8001-a3a3-4e76-80aa-1c969079ce4c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:15.018617 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcd8b1-300b-4b15-9043-80b0b089b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:15.019259 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcd8b1-300b-4b15-9043-80b0b089b960 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:15.019532 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcd8b1-300b-4b15-9043-80b0b089b960 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:15.019802 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcd8b1-300b-4b15-9043-80b0b089b960 None admin] PATH_INFO: `/v3/users/208a6871d27c4866bbf0c0e82fb2c685` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:15.035426 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcd8b1-300b-4b15-9043-80b0b089b960 None admin] RBAC: Authorizing `identity:get_user(user_id=208a6871d27c4866bbf0c0e82fb2c685)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:15.036952 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcd8b1-300b-4b15-9043-80b0b089b960 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:15.039108 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 161/308] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:14 2022] GET /identity/v3/users/208a6871d27c4866bbf0c0e82fb2c685 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:15.047641 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcd8b1-300b-4b15-9043-80b0b089b960 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:15.055459 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26249c52-e206-4732-8445-1a1bd7327f69 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:15.100029 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725212b-3bae-4158-8a37-1e5e6f4e290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:15.100596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725212b-3bae-4158-8a37-1e5e6f4e290b None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:15.100872 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725212b-3bae-4158-8a37-1e5e6f4e290b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:15.101143 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725212b-3bae-4158-8a37-1e5e6f4e290b None admin] PATH_INFO: `/v3/system/users/89144156f2ba46ec9dc7871748244329/roles/9e1823c929634538b474878b5a80c62d` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:15.104226 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725212b-3bae-4158-8a37-1e5e6f4e290b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=89144156f2ba46ec9dc7871748244329, role_id=9e1823c929634538b474878b5a80c62d)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:15.105691 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725212b-3bae-4158-8a37-1e5e6f4e290b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:15.112596 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:15.118565 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 148/309] 10.222.0.47 () {58 vars in 1334 bytes} [Tue Aug 23 16:10:14 2022] PUT /identity/v3/system/users/89144156f2ba46ec9dc7871748244329/roles/9e1823c929634538b474878b5a80c62d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:15.199208 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcd8b1-300b-4b15-9043-80b0b089b960 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:15.239978 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8af2b-1226-4918-b078-76de8d5f5609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:15.240593 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8af2b-1226-4918-b078-76de8d5f5609 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:15.240867 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8af2b-1226-4918-b078-76de8d5f5609 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:15.241134 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8af2b-1226-4918-b078-76de8d5f5609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:15.241868 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8af2b-1226-4918-b078-76de8d5f5609 None admin] RBAC: Adding query filter params (role.id=f0d638fc9d904725ae87d968c84512df, user.id=208a6871d27c4866bbf0c0e82fb2c685, scope.system=all) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:15.242204 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8af2b-1226-4918-b078-76de8d5f5609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:15.243838 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8af2b-1226-4918-b078-76de8d5f5609 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:15.250129 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 162/310] 10.222.0.47 () {56 vars in 1308 bytes} [Tue Aug 23 16:10:15 2022] GET /identity/v3/role_assignments?user.id=208a6871d27c4866bbf0c0e82fb2c685&scope.system=all&role.id=f0d638fc9d904725ae87d968c84512df => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:15.363962 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20a7be-8260-4a70-889f-7f21c06bceaf None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:15.364147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20a7be-8260-4a70-889f-7f21c06bceaf None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:15.364419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20a7be-8260-4a70-889f-7f21c06bceaf None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:15.366019 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 149/311] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:15.371665 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b36de-dd4c-47c7-a695-3b31810db0df None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:15.371964 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b36de-dd4c-47c7-a695-3b31810db0df None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:15.372218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b36de-dd4c-47c7-a695-3b31810db0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:15.391443 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-711b36de-dd4c-47c7-a695-3b31810db0df None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:15.392689 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-711b36de-dd4c-47c7-a695-3b31810db0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:15.465617 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 163/312] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:15.789911 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20a7be-8260-4a70-889f-7f21c06bceaf None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:15.803159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:15.907697 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20a7be-8260-4a70-889f-7f21c06bceaf None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:15.941564 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd582e70-89c3-470c-9e3f-587784d7888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:15.942218 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd582e70-89c3-470c-9e3f-587784d7888f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:15.942496 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd582e70-89c3-470c-9e3f-587784d7888f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:15.942827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd582e70-89c3-470c-9e3f-587784d7888f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:15.953029 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd582e70-89c3-470c-9e3f-587784d7888f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-fd582e70-89c3-470c-9e3f-587784d7888f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:15.958431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:15.959485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:15.960469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:15.960469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:15.960469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:15.960469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:15.960469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:15.960469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:15.960469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:15.960469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:15.960469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:15.960469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:15.960469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:10:15.960469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:15.962984 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 150/313] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:15.968399 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b36de-dd4c-47c7-a695-3b31810db0df None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:15.996664 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:16.072407 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b36de-dd4c-47c7-a695-3b31810db0df None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:16.106908 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab971ff-0edf-4a21-8dcc-3d7d421503e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:16.107678 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab971ff-0edf-4a21-8dcc-3d7d421503e7 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:16.107957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab971ff-0edf-4a21-8dcc-3d7d421503e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:16.108229 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab971ff-0edf-4a21-8dcc-3d7d421503e7 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:16.108944 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab971ff-0edf-4a21-8dcc-3d7d421503e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:16.109248 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab971ff-0edf-4a21-8dcc-3d7d421503e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:16.110675 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab971ff-0edf-4a21-8dcc-3d7d421503e7 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:16.120901 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 164/314] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:16.127884 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd582e70-89c3-470c-9e3f-587784d7888f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:16.214908 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:16.247268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd582e70-89c3-470c-9e3f-587784d7888f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:16.283083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ed7c8-d8a6-4837-96b2-75010a02fa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:16.284083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ed7c8-d8a6-4837-96b2-75010a02fa74 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:16.284551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ed7c8-d8a6-4837-96b2-75010a02fa74 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:16.285007 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ed7c8-d8a6-4837-96b2-75010a02fa74 None admin] PATH_INFO: `/v3/users/edb97eee1b724a3db6bedae55332e081` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:16.286359 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ed7c8-d8a6-4837-96b2-75010a02fa74 None admin] RBAC: Authorizing `identity:get_user(user_id=edb97eee1b724a3db6bedae55332e081)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:16.288034 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ed7c8-d8a6-4837-96b2-75010a02fa74 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:16.290238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 151/315] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:16 2022] GET /identity/v3/users/edb97eee1b724a3db6bedae55332e081 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:16.299414 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab971ff-0edf-4a21-8dcc-3d7d421503e7 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:16.398672 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:16.408850 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab971ff-0edf-4a21-8dcc-3d7d421503e7 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:16.445610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec78e33-7191-4678-b045-9d6522efc71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:16.446254 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec78e33-7191-4678-b045-9d6522efc71e None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:16.446530 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec78e33-7191-4678-b045-9d6522efc71e None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:16.446799 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec78e33-7191-4678-b045-9d6522efc71e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:16.523461 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec78e33-7191-4678-b045-9d6522efc71e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:16.524936 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec78e33-7191-4678-b045-9d6522efc71e None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:16.620021 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:16.630468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 165/316] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:16.635868 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ed7c8-d8a6-4837-96b2-75010a02fa74 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:16.733809 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7805897-5c4a-4e10-890f-b2edcbe39a79 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:16.734187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7805897-5c4a-4e10-890f-b2edcbe39a79 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:16.734382 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7805897-5c4a-4e10-890f-b2edcbe39a79 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:16.735736 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 166/317] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:16.740933 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff761cff-6a76-44cf-857f-8d8158b952ba None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:16.741212 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff761cff-6a76-44cf-857f-8d8158b952ba None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:16.741485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff761cff-6a76-44cf-857f-8d8158b952ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:16.744386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ed7c8-d8a6-4837-96b2-75010a02fa74 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:16.761445 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-ff761cff-6a76-44cf-857f-8d8158b952ba None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:16.762762 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-ff761cff-6a76-44cf-857f-8d8158b952ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:16.779455 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf1f86-22f7-4e78-9056-30581a241495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:16.780858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf1f86-22f7-4e78-9056-30581a241495 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:16.781133 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf1f86-22f7-4e78-9056-30581a241495 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:16.781400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf1f86-22f7-4e78-9056-30581a241495 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:16.782809 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf1f86-22f7-4e78-9056-30581a241495 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:16.784979 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf1f86-22f7-4e78-9056-30581a241495 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:16.787541 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 152/318] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:16 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:16.793507 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf1f86-22f7-4e78-9056-30581a241495 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:16.804668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:16.844836 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 167/319] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:16.906174 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf1f86-22f7-4e78-9056-30581a241495 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:16.941644 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dbcc9-0156-4ef0-85c8-0d8191bc1b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:16.943159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dbcc9-0156-4ef0-85c8-0d8191bc1b88 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:16.943634 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dbcc9-0156-4ef0-85c8-0d8191bc1b88 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:16.944094 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dbcc9-0156-4ef0-85c8-0d8191bc1b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:16.945031 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dbcc9-0156-4ef0-85c8-0d8191bc1b88 None admin] RBAC: Adding query filter params (role.id=f0d638fc9d904725ae87d968c84512df, scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5, user.id=edb97eee1b724a3db6bedae55332e081) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:16.945533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dbcc9-0156-4ef0-85c8-0d8191bc1b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:16.947214 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dbcc9-0156-4ef0-85c8-0d8191bc1b88 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:16.954159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 153/320] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:16 2022] GET /identity/v3/role_assignments?user.id=edb97eee1b724a3db6bedae55332e081&scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5&role.id=f0d638fc9d904725ae87d968c84512df => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:17.176904 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff761cff-6a76-44cf-857f-8d8158b952ba None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:17.282848 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff761cff-6a76-44cf-857f-8d8158b952ba None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:17.304256 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:17.320889 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b81430-b388-4d22-9490-40d96ba1f7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:17.321549 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b81430-b388-4d22-9490-40d96ba1f7ef None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:17.321845 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b81430-b388-4d22-9490-40d96ba1f7ef None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:17.322136 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b81430-b388-4d22-9490-40d96ba1f7ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:17.323346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b81430-b388-4d22-9490-40d96ba1f7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:17.324844 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b81430-b388-4d22-9490-40d96ba1f7ef None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:17.326747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 168/321] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:17.332354 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dbcc9-0156-4ef0-85c8-0d8191bc1b88 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:17.410141 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:17.442789 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dbcc9-0156-4ef0-85c8-0d8191bc1b88 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:17.476401 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffba15-425f-42d3-a91f-0dbe1b2ca62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:17.477010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffba15-425f-42d3-a91f-0dbe1b2ca62c None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:17.477287 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffba15-425f-42d3-a91f-0dbe1b2ca62c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:17.477558 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffba15-425f-42d3-a91f-0dbe1b2ca62c None admin] PATH_INFO: `/v3/groups` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:17.478203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffba15-425f-42d3-a91f-0dbe1b2ca62c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:17.479667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffba15-425f-42d3-a91f-0dbe1b2ca62c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:17.484954 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0cf00-4906-489e-8aa2-6fd0c65dfef2 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:17.485493 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0cf00-4906-489e-8aa2-6fd0c65dfef2 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:17.485768 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0cf00-4906-489e-8aa2-6fd0c65dfef2 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:17.487918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 169/322] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:17.493308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744916-69ce-46ca-b357-20b594272335 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:17.493675 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744916-69ce-46ca-b357-20b594272335 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:17.494063 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744916-69ce-46ca-b357-20b594272335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:17.506159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 154/323] 10.222.0.47 () {60 vars in 1134 bytes} [Tue Aug 23 16:10:17 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:10:17.514110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-68744916-69ce-46ca-b357-20b594272335 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:17.515332 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-68744916-69ce-46ca-b357-20b594272335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:17.520954 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eea6d-f258-49ba-a075-abfbb980b868 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:17.521291 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eea6d-f258-49ba-a075-abfbb980b868 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:17.521510 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eea6d-f258-49ba-a075-abfbb980b868 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:17.523181 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 155/324] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:17.528771 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c167031-e34f-4ea9-93b8-2bffc7685201 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:17.529063 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c167031-e34f-4ea9-93b8-2bffc7685201 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:17.529320 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c167031-e34f-4ea9-93b8-2bffc7685201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:17.549323 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-4c167031-e34f-4ea9-93b8-2bffc7685201 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:17.550576 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-4c167031-e34f-4ea9-93b8-2bffc7685201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:17.594371 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 170/325] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:17.634038 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 156/326] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:17.914784 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68744916-69ce-46ca-b357-20b594272335 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:17.964940 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c167031-e34f-4ea9-93b8-2bffc7685201 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:18.039453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68744916-69ce-46ca-b357-20b594272335 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:18.043853 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:18.064074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:18.087630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029378a-e250-4fb4-94d2-f5944e3feb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:18.088723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029378a-e250-4fb4-94d2-f5944e3feb27 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:18.089419 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029378a-e250-4fb4-94d2-f5944e3feb27 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:18.090093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029378a-e250-4fb4-94d2-f5944e3feb27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:18.097643 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c167031-e34f-4ea9-93b8-2bffc7685201 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:18.103623 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029378a-e250-4fb4-94d2-f5944e3feb27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-d029378a-e250-4fb4-94d2-f5944e3feb27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:18.108972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:18.109879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:18.110699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 171/327] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:18.116387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029378a-e250-4fb4-94d2-f5944e3feb27 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:18.144339 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b64102-2d06-4b84-b356-b4f6ddb34a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:18.145526 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b64102-2d06-4b84-b356-b4f6ddb34a62 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:18.146470 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b64102-2d06-4b84-b356-b4f6ddb34a62 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:18.146915 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b64102-2d06-4b84-b356-b4f6ddb34a62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:18.161591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b64102-2d06-4b84-b356-b4f6ddb34a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-a9b64102-2d06-4b84-b356-b4f6ddb34a62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:18.167917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:18.168788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:18.169591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 157/328] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:18.176505 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b64102-2d06-4b84-b356-b4f6ddb34a62 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:18.246230 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029378a-e250-4fb4-94d2-f5944e3feb27 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:18.294625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e6280-7741-418f-854c-f6ab22b30763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:18.294977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e6280-7741-418f-854c-f6ab22b30763 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:18.295240 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e6280-7741-418f-854c-f6ab22b30763 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:18.295509 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e6280-7741-418f-854c-f6ab22b30763 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:18.296212 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e6280-7741-418f-854c-f6ab22b30763 None admin] RBAC: Adding query filter params (name=member) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:18.296707 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e6280-7741-418f-854c-f6ab22b30763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:18.298049 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e6280-7741-418f-854c-f6ab22b30763 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:18.303566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b64102-2d06-4b84-b356-b4f6ddb34a62 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:18.309968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 172/329] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:18.315624 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e6280-7741-418f-854c-f6ab22b30763 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:18.330415 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:18.349429 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cbdd1-29b3-4746-a8f0-a0df25250d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:18.351007 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cbdd1-29b3-4746-a8f0-a0df25250d6e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:18.351463 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cbdd1-29b3-4746-a8f0-a0df25250d6e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:18.352133 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cbdd1-29b3-4746-a8f0-a0df25250d6e None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:18.353240 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cbdd1-29b3-4746-a8f0-a0df25250d6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:18.353715 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cbdd1-29b3-4746-a8f0-a0df25250d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:18.355821 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cbdd1-29b3-4746-a8f0-a0df25250d6e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:18.366435 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 158/330] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:18.371641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cbdd1-29b3-4746-a8f0-a0df25250d6e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:18.372656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:18.442309 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e6280-7741-418f-854c-f6ab22b30763 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:18.479018 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c6217-ecb5-44ec-a7bc-1a7379cd014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:18.479018 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c6217-ecb5-44ec-a7bc-1a7379cd014b None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:18.479018 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c6217-ecb5-44ec-a7bc-1a7379cd014b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:18.479380 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c6217-ecb5-44ec-a7bc-1a7379cd014b None admin] PATH_INFO: `/v3/users/89144156f2ba46ec9dc7871748244329` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:18.480381 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c6217-ecb5-44ec-a7bc-1a7379cd014b None admin] RBAC: Authorizing `identity:get_user(user_id=89144156f2ba46ec9dc7871748244329)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:18.481852 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c6217-ecb5-44ec-a7bc-1a7379cd014b None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:18.483487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 173/331] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:18 2022] GET /identity/v3/users/89144156f2ba46ec9dc7871748244329 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:18.489127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c6217-ecb5-44ec-a7bc-1a7379cd014b None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:18.489806 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cbdd1-29b3-4746-a8f0-a0df25250d6e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:18.533879 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a128732-954f-4213-bd44-91a8962d2928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:18.535078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a128732-954f-4213-bd44-91a8962d2928 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:18.536407 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a128732-954f-4213-bd44-91a8962d2928 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:18.537671 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a128732-954f-4213-bd44-91a8962d2928 None admin] PATH_INFO: `/v3/users/208a6871d27c4866bbf0c0e82fb2c685` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:18.540908 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a128732-954f-4213-bd44-91a8962d2928 None admin] RBAC: Authorizing `identity:get_user(user_id=208a6871d27c4866bbf0c0e82fb2c685)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:18.542855 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a128732-954f-4213-bd44-91a8962d2928 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:18.544901 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 159/332] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:18 2022] GET /identity/v3/users/208a6871d27c4866bbf0c0e82fb2c685 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:18.556276 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a128732-954f-4213-bd44-91a8962d2928 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:18.626398 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:18.711700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c6217-ecb5-44ec-a7bc-1a7379cd014b None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:18.727775 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:18.731675 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a128732-954f-4213-bd44-91a8962d2928 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:18.778366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc9c80-627b-4f0e-997c-012f8654ae1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:18.778987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc9c80-627b-4f0e-997c-012f8654ae1a None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:18.779259 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc9c80-627b-4f0e-997c-012f8654ae1a None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:18.779526 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc9c80-627b-4f0e-997c-012f8654ae1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:18.780571 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc9c80-627b-4f0e-997c-012f8654ae1a None admin] RBAC: Adding query filter params (role.id=9e1823c929634538b474878b5a80c62d, user.id=89144156f2ba46ec9dc7871748244329, scope.system=all) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:18.780872 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc9c80-627b-4f0e-997c-012f8654ae1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:18.782379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc9c80-627b-4f0e-997c-012f8654ae1a None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:18.801241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb2f33-e314-48bc-87a9-013a64e66f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:18.801903 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb2f33-e314-48bc-87a9-013a64e66f4a None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:18.802227 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb2f33-e314-48bc-87a9-013a64e66f4a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:18.802575 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb2f33-e314-48bc-87a9-013a64e66f4a None admin] PATH_INFO: `/v3/system/users/208a6871d27c4866bbf0c0e82fb2c685/roles/f0d638fc9d904725ae87d968c84512df` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:18.805779 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb2f33-e314-48bc-87a9-013a64e66f4a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=208a6871d27c4866bbf0c0e82fb2c685, role_id=f0d638fc9d904725ae87d968c84512df)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:18.807260 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb2f33-e314-48bc-87a9-013a64e66f4a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:18.812057 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 174/333] 10.222.0.47 () {56 vars in 1308 bytes} [Tue Aug 23 16:10:18 2022] GET /identity/v3/role_assignments?user.id=89144156f2ba46ec9dc7871748244329&scope.system=all&role.id=9e1823c929634538b474878b5a80c62d => generated 510 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:18.846274 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 160/334] 10.222.0.47 () {58 vars in 1334 bytes} [Tue Aug 23 16:10:18 2022] PUT /identity/v3/system/users/208a6871d27c4866bbf0c0e82fb2c685/roles/f0d638fc9d904725ae87d968c84512df => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:20.523725 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ea2a6-f053-405a-9355-680f3b2c9e43 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:20.524229 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ea2a6-f053-405a-9355-680f3b2c9e43 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:20.524531 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ea2a6-f053-405a-9355-680f3b2c9e43 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:20.526886 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 175/335] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:20.540553 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33802896-8527-4709-83c2-846d8c046f7e None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:20.541547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33802896-8527-4709-83c2-846d8c046f7e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:20.542186 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33802896-8527-4709-83c2-846d8c046f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:20.572534 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-33802896-8527-4709-83c2-846d8c046f7e None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:20.574108 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-33802896-8527-4709-83c2-846d8c046f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:20.693464 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 161/336] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:20.868263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ecb06-f1d0-4a8b-8e75-667d57de0378 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:20.869018 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ecb06-f1d0-4a8b-8e75-667d57de0378 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:20.869500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ecb06-f1d0-4a8b-8e75-667d57de0378 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:20.871331 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 176/337] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:20.880425 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8a3d1-92b2-436f-82a9-ca1c585aad33 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:20.880719 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8a3d1-92b2-436f-82a9-ca1c585aad33 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:20.880992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8a3d1-92b2-436f-82a9-ca1c585aad33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:20.903007 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-45d8a3d1-92b2-436f-82a9-ca1c585aad33 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:20.904198 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-45d8a3d1-92b2-436f-82a9-ca1c585aad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:20.956981 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:21.000915 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 162/338] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:21.211135 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ecb06-f1d0-4a8b-8e75-667d57de0378 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:21.347962 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ecb06-f1d0-4a8b-8e75-667d57de0378 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:21.388567 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0e14a-43c0-422d-ae36-08f89b8ba9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:21.389564 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0e14a-43c0-422d-ae36-08f89b8ba9f6 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:21.390052 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0e14a-43c0-422d-ae36-08f89b8ba9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:21.390539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0e14a-43c0-422d-ae36-08f89b8ba9f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:21.404142 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0e14a-43c0-422d-ae36-08f89b8ba9f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-7ff0e14a-43c0-422d-ae36-08f89b8ba9f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:21.410324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:21.411201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:21.412043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:21.412043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:21.412043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:21.412043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:21.412043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:21.412043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:21.412043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:21.412043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:21.412043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:21.412043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:21.412043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:21.412043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:21.414689 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 177/339] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:21.421422 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8a3d1-92b2-436f-82a9-ca1c585aad33 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:21.579756 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8a3d1-92b2-436f-82a9-ca1c585aad33 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:21.605124 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0e14a-43c0-422d-ae36-08f89b8ba9f6 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:21.638724 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cb4aa-75e7-4334-8216-483f05f0013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:21.639343 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb4aa-75e7-4334-8216-483f05f0013b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:21.639631 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb4aa-75e7-4334-8216-483f05f0013b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:21.639978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb4aa-75e7-4334-8216-483f05f0013b None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:21.640818 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cb4aa-75e7-4334-8216-483f05f0013b None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:21.641165 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cb4aa-75e7-4334-8216-483f05f0013b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:21.643051 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cb4aa-75e7-4334-8216-483f05f0013b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:21.661007 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 163/340] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:21.667403 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cb4aa-75e7-4334-8216-483f05f0013b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:21.670085 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:21.762454 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:21.818654 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0e14a-43c0-422d-ae36-08f89b8ba9f6 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:21.867516 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210e804-375f-4ec3-b3b7-3affc095526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:21.868512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210e804-375f-4ec3-b3b7-3affc095526a None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:21.868929 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210e804-375f-4ec3-b3b7-3affc095526a None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:21.869337 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210e804-375f-4ec3-b3b7-3affc095526a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:21.883667 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210e804-375f-4ec3-b3b7-3affc095526a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:21.885721 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cb4aa-75e7-4334-8216-483f05f0013b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-f210e804-375f-4ec3-b3b7-3affc095526a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:21.895087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:21.896213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:21.897201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:21.897201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:21.897201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:21.897201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:21.897201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:21.897201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:21.897201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:21.897201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:21.897201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:21.897201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:21.897201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:21.897201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:21.900074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 178/341] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:10:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:21.901468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2499b-2eeb-4a02-99d9-dd41e1db1a31 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:21.901937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2499b-2eeb-4a02-99d9-dd41e1db1a31 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:21.902403 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2499b-2eeb-4a02-99d9-dd41e1db1a31 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:21.903801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 179/342] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:21.909162 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2499b-2eeb-4a02-99d9-dd41e1db1a31 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:21.982107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebe8c3-cbe8-4854-8025-fa124252d567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:21.983107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebe8c3-cbe8-4854-8025-fa124252d567 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:21.983557 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebe8c3-cbe8-4854-8025-fa124252d567 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:21.983995 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebe8c3-cbe8-4854-8025-fa124252d567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:22.057148 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:22.089032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2499b-2eeb-4a02-99d9-dd41e1db1a31 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:22.103653 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebe8c3-cbe8-4854-8025-fa124252d567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:22.105176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebe8c3-cbe8-4854-8025-fa124252d567 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:22.147105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:22.165417 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04649cf2-fa3f-44b4-ba5b-f232343e55ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:22.166310 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04649cf2-fa3f-44b4-ba5b-f232343e55ba None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:22.166575 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04649cf2-fa3f-44b4-ba5b-f232343e55ba None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:22.167062 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04649cf2-fa3f-44b4-ba5b-f232343e55ba None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:22.167916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04649cf2-fa3f-44b4-ba5b-f232343e55ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:22.168403 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04649cf2-fa3f-44b4-ba5b-f232343e55ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:22.169957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04649cf2-fa3f-44b4-ba5b-f232343e55ba None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:22.183127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 180/343] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:22.184753 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead4c7-807a-44da-8935-2c7cafc00cbc None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:22.185213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead4c7-807a-44da-8935-2c7cafc00cbc None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:22.185651 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead4c7-807a-44da-8935-2c7cafc00cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:22.212416 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-d8ead4c7-807a-44da-8935-2c7cafc00cbc None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:22.213897 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-d8ead4c7-807a-44da-8935-2c7cafc00cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:22.238877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 164/344] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:22.244226 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85ccf9-ad0e-4ec5-9e30-2fd593160d19 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:22.244512 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85ccf9-ad0e-4ec5-9e30-2fd593160d19 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:22.244781 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85ccf9-ad0e-4ec5-9e30-2fd593160d19 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:22.250042 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 165/345] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:22.250042 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85ccf9-ad0e-4ec5-9e30-2fd593160d19 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:22.313557 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 181/346] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:22.314839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ead4c7-807a-44da-8935-2c7cafc00cbc None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:22.389036 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85ccf9-ad0e-4ec5-9e30-2fd593160d19 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:22.426217 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:22.426803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317f950-9b65-4fac-b241-9b12ca242ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:22.427844 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317f950-9b65-4fac-b241-9b12ca242ea6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:22.428415 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317f950-9b65-4fac-b241-9b12ca242ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:22.428915 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317f950-9b65-4fac-b241-9b12ca242ea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:22.434182 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:22.452019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ead4c7-807a-44da-8935-2c7cafc00cbc None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:22.489156 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d47ca8-6724-42a6-8c18-4fb34606a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:22.489823 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d47ca8-6724-42a6-8c18-4fb34606a422 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:22.490183 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d47ca8-6724-42a6-8c18-4fb34606a422 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:22.490455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d47ca8-6724-42a6-8c18-4fb34606a422 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:22.491592 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d47ca8-6724-42a6-8c18-4fb34606a422 None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:22.493124 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d47ca8-6724-42a6-8c18-4fb34606a422 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:22.496365 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 182/347] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:22 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:22.497631 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85c6af-1f2c-45f7-ae01-e7af71126ead None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:22.497907 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85c6af-1f2c-45f7-ae01-e7af71126ead None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:22.498299 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85c6af-1f2c-45f7-ae01-e7af71126ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:22.506727 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317f950-9b65-4fac-b241-9b12ca242ea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:22.510015 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317f950-9b65-4fac-b241-9b12ca242ea6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:22.518220 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-ea85c6af-1f2c-45f7-ae01-e7af71126ead None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:22.519475 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-ea85c6af-1f2c-45f7-ae01-e7af71126ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:22.595073 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 183/348] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:22.596275 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb744788-7f72-4430-887f-06aa005c1858 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:22.596711 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb744788-7f72-4430-887f-06aa005c1858 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:22.597118 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb744788-7f72-4430-887f-06aa005c1858 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:22.598515 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 184/349] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:22.599492 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb744788-7f72-4430-887f-06aa005c1858 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:22.635530 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 166/350] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:22.637387 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e184-a657-4b97-906a-99db42904b80 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:22.637807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e184-a657-4b97-906a-99db42904b80 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:22.638395 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e184-a657-4b97-906a-99db42904b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:22.667033 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-d3f2e184-a657-4b97-906a-99db42904b80 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:22.668833 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-d3f2e184-a657-4b97-906a-99db42904b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:22.697548 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:22.723749 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:22.726195 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb744788-7f72-4430-887f-06aa005c1858 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:22.774635 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd714d3-a30c-440a-a1a8-d7d837be8564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:22.777311 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd714d3-a30c-440a-a1a8-d7d837be8564 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:22.777311 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd714d3-a30c-440a-a1a8-d7d837be8564 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:22.777311 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd714d3-a30c-440a-a1a8-d7d837be8564 None admin] PATH_INFO: `/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:22.787339 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 167/351] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:22.788205 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e184-a657-4b97-906a-99db42904b80 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:22.789238 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd714d3-a30c-440a-a1a8-d7d837be8564 None admin] RBAC: Authorizing `identity:get_group(group_id=a32e1cf4ade4453d8c46c9adf07a1c9d)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:22.790766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd714d3-a30c-440a-a1a8-d7d837be8564 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:22.792435 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 185/352] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:22 2022] GET /identity/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:22.793190 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd714d3-a30c-440a-a1a8-d7d837be8564 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:22.910861 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd714d3-a30c-440a-a1a8-d7d837be8564 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:22.959843 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587af352-178c-4caf-911e-5fa266f42076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:22.960765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587af352-178c-4caf-911e-5fa266f42076 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:22.961046 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587af352-178c-4caf-911e-5fa266f42076 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:22.961317 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587af352-178c-4caf-911e-5fa266f42076 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:22.972666 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:22.977469 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587af352-178c-4caf-911e-5fa266f42076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:22.985773 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e184-a657-4b97-906a-99db42904b80 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-587af352-178c-4caf-911e-5fa266f42076 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:22.989206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:22.990234 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:22.991090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:22.991090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:22.991090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:22.991090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:22.991090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:22.991090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:22.991090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:22.991090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:22.991090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:22.991090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:22.991090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:22.991090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:22.994107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 186/353] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:22.995167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587af352-178c-4caf-911e-5fa266f42076 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:23.032028 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43825abf-d2a1-4609-a681-1c2bd9c311ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:23.033280 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43825abf-d2a1-4609-a681-1c2bd9c311ef None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:23.033875 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43825abf-d2a1-4609-a681-1c2bd9c311ef None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:23.034349 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43825abf-d2a1-4609-a681-1c2bd9c311ef None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:23.035708 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43825abf-d2a1-4609-a681-1c2bd9c311ef None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:23.037438 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43825abf-d2a1-4609-a681-1c2bd9c311ef None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:23.039642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 168/354] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:22 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:23.041085 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1ba2-7f78-43c3-9551-23bae8f3a173 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:23.041573 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1ba2-7f78-43c3-9551-23bae8f3a173 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:23.046150 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1ba2-7f78-43c3-9551-23bae8f3a173 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:23.047907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 169/355] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:23.048823 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af1ba2-7f78-43c3-9551-23bae8f3a173 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:23.100679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:23.129624 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587af352-178c-4caf-911e-5fa266f42076 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:23.170685 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03908f71-d80b-4a68-81aa-18b97b9d16af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:23.171334 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03908f71-d80b-4a68-81aa-18b97b9d16af None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:23.171615 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03908f71-d80b-4a68-81aa-18b97b9d16af None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:23.172055 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03908f71-d80b-4a68-81aa-18b97b9d16af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:23.172786 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03908f71-d80b-4a68-81aa-18b97b9d16af None admin] RBAC: Adding query filter params (group.id=a32e1cf4ade4453d8c46c9adf07a1c9d, role.id=9e1823c929634538b474878b5a80c62d, scope.project.id=95d997fd888745edaff8fd28f4d1dde1) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:23.173099 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03908f71-d80b-4a68-81aa-18b97b9d16af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:23.174572 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03908f71-d80b-4a68-81aa-18b97b9d16af None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:23.182269 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af1ba2-7f78-43c3-9551-23bae8f3a173 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:23.184773 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 187/356] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 23 16:10:22 2022] GET /identity/v3/role_assignments?group.id=a32e1cf4ade4453d8c46c9adf07a1c9d&scope.project.id=95d997fd888745edaff8fd28f4d1dde1&role.id=9e1823c929634538b474878b5a80c62d => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:23.185465 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03908f71-d80b-4a68-81aa-18b97b9d16af None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:23.230051 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8e0c7-43df-4e88-9de7-8a3ed0b50e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:23.230854 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8e0c7-43df-4e88-9de7-8a3ed0b50e98 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:23.232076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8e0c7-43df-4e88-9de7-8a3ed0b50e98 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:23.232357 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8e0c7-43df-4e88-9de7-8a3ed0b50e98 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:23.233526 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8e0c7-43df-4e88-9de7-8a3ed0b50e98 None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:23.233526 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8e0c7-43df-4e88-9de7-8a3ed0b50e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:23.234914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8e0c7-43df-4e88-9de7-8a3ed0b50e98 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:23.252215 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 170/357] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:23.255418 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57857ebd-d59c-4bbb-b86a-3d354a6bf501 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:23.255799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57857ebd-d59c-4bbb-b86a-3d354a6bf501 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:23.256001 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57857ebd-d59c-4bbb-b86a-3d354a6bf501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:23.274176 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:23.278949 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-57857ebd-d59c-4bbb-b86a-3d354a6bf501 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:23.280500 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-57857ebd-d59c-4bbb-b86a-3d354a6bf501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:23.331103 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03908f71-d80b-4a68-81aa-18b97b9d16af None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:23.383535 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea708a-56bc-4aab-ba5b-f87759953463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:23.383535 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea708a-56bc-4aab-ba5b-f87759953463 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:23.383830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea708a-56bc-4aab-ba5b-f87759953463 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:23.384073 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea708a-56bc-4aab-ba5b-f87759953463 None admin] PATH_INFO: `/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:23.385770 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea708a-56bc-4aab-ba5b-f87759953463 None admin] RBAC: Authorizing `identity:get_group(group_id=a32e1cf4ade4453d8c46c9adf07a1c9d)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:23.386777 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 171/358] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:23.387793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57857ebd-d59c-4bbb-b86a-3d354a6bf501 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:23.388665 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea708a-56bc-4aab-ba5b-f87759953463 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:23.390594 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 188/359] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:23 2022] GET /identity/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:23.391603 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea708a-56bc-4aab-ba5b-f87759953463 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:23.422665 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:23.526649 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57857ebd-d59c-4bbb-b86a-3d354a6bf501 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:23.527450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea708a-56bc-4aab-ba5b-f87759953463 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:23.567932 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:23.572467 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a821b9-a712-451c-8ecc-8248921bae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:23.574613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a821b9-a712-451c-8ecc-8248921bae3f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:23.575259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a821b9-a712-451c-8ecc-8248921bae3f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:23.575797 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a821b9-a712-451c-8ecc-8248921bae3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:23.576427 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b3373-3bfd-4932-baf5-bf5af1f82a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:23.577225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b3373-3bfd-4932-baf5-bf5af1f82a34 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:23.577503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b3373-3bfd-4932-baf5-bf5af1f82a34 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:23.577770 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b3373-3bfd-4932-baf5-bf5af1f82a34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:23.591181 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a821b9-a712-451c-8ecc-8248921bae3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:23.592330 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b3373-3bfd-4932-baf5-bf5af1f82a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-c9a821b9-a712-451c-8ecc-8248921bae3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:23.596798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:23.597905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:23.598919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:23.598919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:23.598919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:23.598919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:23.598919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:23.598919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:23.598919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:23.598919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:23.598919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:23.598919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:23.598919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:23.598919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-4d8b3373-3bfd-4932-baf5-bf5af1f82a34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:23.599747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:23.600760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:23.601767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:23.601767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:23.601767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:23.601767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:23.601767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:23.601767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:23.601767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:23.601767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:23.601767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:23.601767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:23.601767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:10:23.601767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:23.602919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 189/360] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:23.603780 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b3373-3bfd-4932-baf5-bf5af1f82a34 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:23.604466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 172/361] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:10:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:23.605514 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a821b9-a712-451c-8ecc-8248921bae3f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:23.756636 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b3373-3bfd-4932-baf5-bf5af1f82a34 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:23.766448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a821b9-a712-451c-8ecc-8248921bae3f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:23.782406 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:23.804690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c9b58-5515-42c2-b62d-71e44c968cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:23.805872 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c9b58-5515-42c2-b62d-71e44c968cb3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:23.806397 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c9b58-5515-42c2-b62d-71e44c968cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:23.806905 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c9b58-5515-42c2-b62d-71e44c968cb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:23.816753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f8278-34fb-4450-8da1-29b65344a4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:23.817360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f8278-34fb-4450-8da1-29b65344a4cf None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:23.817630 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f8278-34fb-4450-8da1-29b65344a4cf None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:23.817894 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f8278-34fb-4450-8da1-29b65344a4cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:23.818670 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f8278-34fb-4450-8da1-29b65344a4cf None admin] RBAC: Adding query filter params (group.id=a32e1cf4ade4453d8c46c9adf07a1c9d, role.id=d742fa5aed224c11a39ece1d5178d3ca, scope.project.id=95d997fd888745edaff8fd28f4d1dde1) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:23.818972 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f8278-34fb-4450-8da1-29b65344a4cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:23.821094 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f8278-34fb-4450-8da1-29b65344a4cf None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:23.827796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 173/362] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 23 16:10:23 2022] GET /identity/v3/role_assignments?group.id=a32e1cf4ade4453d8c46c9adf07a1c9d&scope.project.id=95d997fd888745edaff8fd28f4d1dde1&role.id=d742fa5aed224c11a39ece1d5178d3ca => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:23.829956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f8278-34fb-4450-8da1-29b65344a4cf None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:23.910424 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:23.915724 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c9b58-5515-42c2-b62d-71e44c968cb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:23.917867 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c9b58-5515-42c2-b62d-71e44c968cb3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:23.986699 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f8278-34fb-4450-8da1-29b65344a4cf None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:24.033917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52ba81-37e8-4e82-89a0-f6d6102f8edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:24.034949 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52ba81-37e8-4e82-89a0-f6d6102f8edf None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:24.035242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52ba81-37e8-4e82-89a0-f6d6102f8edf None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:24.035514 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52ba81-37e8-4e82-89a0-f6d6102f8edf None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:24.036198 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52ba81-37e8-4e82-89a0-f6d6102f8edf None admin] RBAC: Adding query filter params (name=reader) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:24.036497 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52ba81-37e8-4e82-89a0-f6d6102f8edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:24.039526 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52ba81-37e8-4e82-89a0-f6d6102f8edf None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:24.051351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 174/363] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:24.052201 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52ba81-37e8-4e82-89a0-f6d6102f8edf None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:24.053435 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 190/364] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:24.054338 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c9b58-5515-42c2-b62d-71e44c968cb3 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:24.075391 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:24.161566 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:24.168932 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52ba81-37e8-4e82-89a0-f6d6102f8edf None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:24.172383 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c9b58-5515-42c2-b62d-71e44c968cb3 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:24.208471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf77bd9-b83b-4eef-b471-1b1c0daa1e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:24.209179 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf77bd9-b83b-4eef-b471-1b1c0daa1e20 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:24.209457 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf77bd9-b83b-4eef-b471-1b1c0daa1e20 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:24.209781 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf77bd9-b83b-4eef-b471-1b1c0daa1e20 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:24.210713 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf77bd9-b83b-4eef-b471-1b1c0daa1e20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:24.210955 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf77bd9-b83b-4eef-b471-1b1c0daa1e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:24.212365 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf77bd9-b83b-4eef-b471-1b1c0daa1e20 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:24.215923 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044c4a-09e1-4738-a306-044ddea79e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:24.216837 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044c4a-09e1-4738-a306-044ddea79e1c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:24.217338 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044c4a-09e1-4738-a306-044ddea79e1c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:24.217827 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044c4a-09e1-4738-a306-044ddea79e1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:24.223088 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 175/365] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:24.224059 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf77bd9-b83b-4eef-b471-1b1c0daa1e20 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:24.231137 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb044c4a-09e1-4738-a306-044ddea79e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-cb044c4a-09e1-4738-a306-044ddea79e1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:24.236534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:24.237488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:24.238453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:24.238453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:24.238453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:24.238453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:24.238453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:24.238453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:24.238453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:24.238453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:24.238453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:24.238453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:24.238453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:10:24.238453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:24.240940 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 191/366] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:10:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:24.242323 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044c4a-09e1-4738-a306-044ddea79e1c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:24.309687 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:24.337252 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf77bd9-b83b-4eef-b471-1b1c0daa1e20 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:24.368784 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044c4a-09e1-4738-a306-044ddea79e1c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:24.385149 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023859d2-5550-4be8-9b9e-800a6c820dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:24.386263 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023859d2-5550-4be8-9b9e-800a6c820dae None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:24.386755 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023859d2-5550-4be8-9b9e-800a6c820dae None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:24.387230 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023859d2-5550-4be8-9b9e-800a6c820dae None admin] PATH_INFO: `/v3/users/208a6871d27c4866bbf0c0e82fb2c685` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:24.388700 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023859d2-5550-4be8-9b9e-800a6c820dae None admin] RBAC: Authorizing `identity:get_user(user_id=208a6871d27c4866bbf0c0e82fb2c685)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:24.390487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023859d2-5550-4be8-9b9e-800a6c820dae None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:24.392421 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 176/367] 10.222.0.47 () {56 vars in 1177 bytes} [Tue Aug 23 16:10:24 2022] GET /identity/v3/users/208a6871d27c4866bbf0c0e82fb2c685 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:24.394455 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023859d2-5550-4be8-9b9e-800a6c820dae None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:24.419461 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9604233-0074-4f1c-93cf-f65f6c06d888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:24.420115 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9604233-0074-4f1c-93cf-f65f6c06d888 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:24.420389 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9604233-0074-4f1c-93cf-f65f6c06d888 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:24.420656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9604233-0074-4f1c-93cf-f65f6c06d888 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:24.421934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9604233-0074-4f1c-93cf-f65f6c06d888 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:24.423426 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9604233-0074-4f1c-93cf-f65f6c06d888 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:24.425285 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 192/368] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:24 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:24.425934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9604233-0074-4f1c-93cf-f65f6c06d888 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:24.459874 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:24.539900 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023859d2-5550-4be8-9b9e-800a6c820dae None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:24.565140 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9604233-0074-4f1c-93cf-f65f6c06d888 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:24.585226 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a66eb7-839a-4c8e-b44a-675d8a2b5ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:24.586137 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a66eb7-839a-4c8e-b44a-675d8a2b5ec2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:24.586567 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a66eb7-839a-4c8e-b44a-675d8a2b5ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:24.587498 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a66eb7-839a-4c8e-b44a-675d8a2b5ec2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:24.602469 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d40cce-312d-4dfa-b0eb-e6822e55736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:24.603242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d40cce-312d-4dfa-b0eb-e6822e55736a None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:24.603367 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d40cce-312d-4dfa-b0eb-e6822e55736a None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:24.603603 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d40cce-312d-4dfa-b0eb-e6822e55736a None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:24.604325 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d40cce-312d-4dfa-b0eb-e6822e55736a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:24.604624 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d40cce-312d-4dfa-b0eb-e6822e55736a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:24.605345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:24.606144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d40cce-312d-4dfa-b0eb-e6822e55736a None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:24.615907 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 193/369] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:24.616870 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d40cce-312d-4dfa-b0eb-e6822e55736a None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:24.684702 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a66eb7-839a-4c8e-b44a-675d8a2b5ec2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:24.686242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a66eb7-839a-4c8e-b44a-675d8a2b5ec2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:24.733098 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:24.757922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d40cce-312d-4dfa-b0eb-e6822e55736a None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:24.809784 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea269fa-8ce3-4d37-886a-fb37e120722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:24.810427 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea269fa-8ce3-4d37-886a-fb37e120722e None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:24.810700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea269fa-8ce3-4d37-886a-fb37e120722e None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:24.811023 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea269fa-8ce3-4d37-886a-fb37e120722e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:24.811758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea269fa-8ce3-4d37-886a-fb37e120722e None admin] RBAC: Adding query filter params (role.id=f0d638fc9d904725ae87d968c84512df, user.id=208a6871d27c4866bbf0c0e82fb2c685, scope.system=all) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:24.812061 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea269fa-8ce3-4d37-886a-fb37e120722e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:24.813493 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea269fa-8ce3-4d37-886a-fb37e120722e None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:24.818516 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 177/370] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:24.820637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a66eb7-839a-4c8e-b44a-675d8a2b5ec2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:24.827959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 194/371] 10.222.0.47 () {56 vars in 1308 bytes} [Tue Aug 23 16:10:24 2022] GET /identity/v3/role_assignments?user.id=208a6871d27c4866bbf0c0e82fb2c685&scope.system=all&role.id=f0d638fc9d904725ae87d968c84512df => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:24.828840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea269fa-8ce3-4d37-886a-fb37e120722e None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:24.882648 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:24.968754 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a66eb7-839a-4c8e-b44a-675d8a2b5ec2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:24.970451 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea269fa-8ce3-4d37-886a-fb37e120722e None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:25.017250 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36498c-0154-4659-880a-ea91ed41dad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:25.018203 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36498c-0154-4659-880a-ea91ed41dad1 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:25.018537 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36498c-0154-4659-880a-ea91ed41dad1 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:25.018873 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36498c-0154-4659-880a-ea91ed41dad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:25.020003 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fceb8-f836-4f24-8b54-fae11e5de920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:25.020851 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fceb8-f836-4f24-8b54-fae11e5de920 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:25.021331 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fceb8-f836-4f24-8b54-fae11e5de920 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:25.022113 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fceb8-f836-4f24-8b54-fae11e5de920 None admin] PATH_INFO: `/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:25.024538 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fceb8-f836-4f24-8b54-fae11e5de920 None admin] RBAC: Authorizing `identity:get_group(group_id=a32e1cf4ade4453d8c46c9adf07a1c9d)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:25.026264 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fceb8-f836-4f24-8b54-fae11e5de920 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:25.028524 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 178/372] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:24 2022] GET /identity/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:25.030632 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fceb8-f836-4f24-8b54-fae11e5de920 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:25.033866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:25.126043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36498c-0154-4659-880a-ea91ed41dad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:25.128284 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36498c-0154-4659-880a-ea91ed41dad1 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:25.153374 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fceb8-f836-4f24-8b54-fae11e5de920 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:25.168348 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:25.209004 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a334e6a-240a-4cd4-969a-d039ad2efb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:25.210043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a334e6a-240a-4cd4-969a-d039ad2efb21 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:25.210550 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a334e6a-240a-4cd4-969a-d039ad2efb21 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:25.211048 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a334e6a-240a-4cd4-969a-d039ad2efb21 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:25.212630 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a334e6a-240a-4cd4-969a-d039ad2efb21 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:25.214551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a334e6a-240a-4cd4-969a-d039ad2efb21 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:25.216582 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 179/373] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:25 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:25.217625 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a334e6a-240a-4cd4-969a-d039ad2efb21 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:25.260242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 195/374] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:25.261102 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36498c-0154-4659-880a-ea91ed41dad1 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:25.307371 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:25.335325 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a334e6a-240a-4cd4-969a-d039ad2efb21 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:25.370782 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36498c-0154-4659-880a-ea91ed41dad1 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:25.375623 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70dfde-6438-499a-bb27-f3f200691d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:25.376668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70dfde-6438-499a-bb27-f3f200691d69 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:25.377154 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70dfde-6438-499a-bb27-f3f200691d69 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:25.377611 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70dfde-6438-499a-bb27-f3f200691d69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:25.378600 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70dfde-6438-499a-bb27-f3f200691d69 None admin] RBAC: Adding query filter params (group.id=a32e1cf4ade4453d8c46c9adf07a1c9d, role.id=9e1823c929634538b474878b5a80c62d, scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:25.379184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70dfde-6438-499a-bb27-f3f200691d69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:25.380996 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70dfde-6438-499a-bb27-f3f200691d69 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:25.388157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 180/375] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 23 16:10:25 2022] GET /identity/v3/role_assignments?group.id=a32e1cf4ade4453d8c46c9adf07a1c9d&scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5&role.id=9e1823c929634538b474878b5a80c62d => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:25.389350 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70dfde-6438-499a-bb27-f3f200691d69 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:25.408414 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83728c0-9d35-4f9c-94fc-837f6f3c779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:25.409050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83728c0-9d35-4f9c-94fc-837f6f3c779d None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:25.409325 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83728c0-9d35-4f9c-94fc-837f6f3c779d None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:25.409595 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83728c0-9d35-4f9c-94fc-837f6f3c779d None admin] PATH_INFO: `/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:25.410770 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83728c0-9d35-4f9c-94fc-837f6f3c779d None admin] RBAC: Authorizing `identity:get_group(group_id=a32e1cf4ade4453d8c46c9adf07a1c9d)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:25.412423 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83728c0-9d35-4f9c-94fc-837f6f3c779d None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:25.414273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 196/376] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:25 2022] GET /identity/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:25.420615 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83728c0-9d35-4f9c-94fc-837f6f3c779d None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:25.443572 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:25.508858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70dfde-6438-499a-bb27-f3f200691d69 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:25.537488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83728c0-9d35-4f9c-94fc-837f6f3c779d None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:25.548793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:25.552176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f728-5d61-4520-8548-d49bcf11ce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:25.552926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f728-5d61-4520-8548-d49bcf11ce98 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:25.553207 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f728-5d61-4520-8548-d49bcf11ce98 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:25.553877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f728-5d61-4520-8548-d49bcf11ce98 None admin] PATH_INFO: `/v3/projects/295f022ed51d4bed9be5939f17b6ff6c` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:25.555519 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f728-5d61-4520-8548-d49bcf11ce98 None admin] RBAC: Authorizing `identity:get_project(project_id=295f022ed51d4bed9be5939f17b6ff6c)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:25.557082 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f728-5d61-4520-8548-d49bcf11ce98 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:25.559333 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 181/377] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:25 2022] GET /identity/v3/projects/295f022ed51d4bed9be5939f17b6ff6c => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:25.565055 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f728-5d61-4520-8548-d49bcf11ce98 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:25.583040 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a8173-5fa9-435e-8fbe-dc92385c0904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:25.583824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a8173-5fa9-435e-8fbe-dc92385c0904 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:25.584106 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a8173-5fa9-435e-8fbe-dc92385c0904 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:25.584376 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a8173-5fa9-435e-8fbe-dc92385c0904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:25.585205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a8173-5fa9-435e-8fbe-dc92385c0904 None admin] RBAC: Adding query filter params (group.id=a32e1cf4ade4453d8c46c9adf07a1c9d, role.id=d742fa5aed224c11a39ece1d5178d3ca, scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:25.585516 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a8173-5fa9-435e-8fbe-dc92385c0904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:25.587019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a8173-5fa9-435e-8fbe-dc92385c0904 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:25.594749 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 197/378] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 23 16:10:25 2022] GET /identity/v3/role_assignments?group.id=a32e1cf4ade4453d8c46c9adf07a1c9d&scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5&role.id=d742fa5aed224c11a39ece1d5178d3ca => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:25.692706 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f728-5d61-4520-8548-d49bcf11ce98 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:25.708476 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:25.731937 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8c2bf-740f-4df1-932b-bc2bbdafcef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:25.732597 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8c2bf-740f-4df1-932b-bc2bbdafcef7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:25.732873 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8c2bf-740f-4df1-932b-bc2bbdafcef7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:25.733146 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8c2bf-740f-4df1-932b-bc2bbdafcef7 None admin] PATH_INFO: `/v3/groups/257a7f4299da4d5f8437a1cb56e891ce` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:25.740109 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8c2bf-740f-4df1-932b-bc2bbdafcef7 None admin] RBAC: Authorizing `identity:get_group(group_id=257a7f4299da4d5f8437a1cb56e891ce)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:25.741656 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8c2bf-740f-4df1-932b-bc2bbdafcef7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:25.743875 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 182/379] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:25 2022] GET /identity/v3/groups/257a7f4299da4d5f8437a1cb56e891ce => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:25.749728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a8173-5fa9-435e-8fbe-dc92385c0904 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:25.888295 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a8173-5fa9-435e-8fbe-dc92385c0904 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:25.923214 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c611614-97b1-4d18-9ce7-5777042a2c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:25.923822 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c611614-97b1-4d18-9ce7-5777042a2c16 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:25.924098 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c611614-97b1-4d18-9ce7-5777042a2c16 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:25.924367 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c611614-97b1-4d18-9ce7-5777042a2c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:25.925095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c611614-97b1-4d18-9ce7-5777042a2c16 None admin] RBAC: Adding query filter params (group.id=257a7f4299da4d5f8437a1cb56e891ce, role.id=5756384fa8d842139e2f1fc44c5088bd, scope.project.id=295f022ed51d4bed9be5939f17b6ff6c) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:25.925399 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c611614-97b1-4d18-9ce7-5777042a2c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:25.926866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c611614-97b1-4d18-9ce7-5777042a2c16 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:25.932823 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 198/380] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 23 16:10:25 2022] GET /identity/v3/role_assignments?group.id=257a7f4299da4d5f8437a1cb56e891ce&scope.project.id=295f022ed51d4bed9be5939f17b6ff6c&role.id=5756384fa8d842139e2f1fc44c5088bd => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:26.068957 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc388d-9bec-4221-aed3-350d3b96edf2 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:26.069460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc388d-9bec-4221-aed3-350d3b96edf2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:26.069460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc388d-9bec-4221-aed3-350d3b96edf2 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:26.071120 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 183/381] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:26.084102 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14fed4-0597-480f-a347-13cc48fd3455 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:26.084409 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14fed4-0597-480f-a347-13cc48fd3455 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:26.084656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14fed4-0597-480f-a347-13cc48fd3455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:26.104320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-cb14fed4-0597-480f-a347-13cc48fd3455 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:26.105540 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-cb14fed4-0597-480f-a347-13cc48fd3455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:26.138728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:26.181655 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 199/382] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:26.525713 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc388d-9bec-4221-aed3-350d3b96edf2 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:26.647518 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc388d-9bec-4221-aed3-350d3b96edf2 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:26.689914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9c41f-d760-4324-bd54-73f0894ffd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:26.690577 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9c41f-d760-4324-bd54-73f0894ffd12 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:26.690854 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9c41f-d760-4324-bd54-73f0894ffd12 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:26.691123 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9c41f-d760-4324-bd54-73f0894ffd12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:26.701729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9c41f-d760-4324-bd54-73f0894ffd12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-d1b9c41f-d760-4324-bd54-73f0894ffd12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:26.707127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:26.708014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:26.708861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 184/383] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:26.715791 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14fed4-0597-480f-a347-13cc48fd3455 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:26.787587 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595187d7-804f-468a-bfd9-2fc87a4bb5a0 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:26.787781 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595187d7-804f-468a-bfd9-2fc87a4bb5a0 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:26.788052 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595187d7-804f-468a-bfd9-2fc87a4bb5a0 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:26.789512 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 185/384] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:26.794358 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b25c-9cf4-4d69-8622-e086cabddb2c None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:26.794632 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b25c-9cf4-4d69-8622-e086cabddb2c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:26.794900 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b25c-9cf4-4d69-8622-e086cabddb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:26.813817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-9371b25c-9cf4-4d69-8622-e086cabddb2c None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:26.815054 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-9371b25c-9cf4-4d69-8622-e086cabddb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:26.850032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14fed4-0597-480f-a347-13cc48fd3455 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:26.869843 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:26.897085 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445863a-e0fb-4d74-ad26-01f194e20913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:26.897762 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445863a-e0fb-4d74-ad26-01f194e20913 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:26.897977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445863a-e0fb-4d74-ad26-01f194e20913 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:26.898301 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445863a-e0fb-4d74-ad26-01f194e20913 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:26.898973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445863a-e0fb-4d74-ad26-01f194e20913 None admin] RBAC: Adding query filter params (name=member) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:26.899274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445863a-e0fb-4d74-ad26-01f194e20913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:26.900665 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445863a-e0fb-4d74-ad26-01f194e20913 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:26.910883 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 200/385] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:26.918237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445863a-e0fb-4d74-ad26-01f194e20913 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:26.957047 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:26.963902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 186/386] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:27.056880 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445863a-e0fb-4d74-ad26-01f194e20913 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:27.100169 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12513e3b-10ab-44a1-b026-d7bf00f71f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:27.100837 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12513e3b-10ab-44a1-b026-d7bf00f71f9f None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:27.101120 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12513e3b-10ab-44a1-b026-d7bf00f71f9f None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:27.101395 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12513e3b-10ab-44a1-b026-d7bf00f71f9f None admin] PATH_INFO: `/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:27.102699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12513e3b-10ab-44a1-b026-d7bf00f71f9f None admin] RBAC: Authorizing `identity:get_group(group_id=a32e1cf4ade4453d8c46c9adf07a1c9d)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:27.104203 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12513e3b-10ab-44a1-b026-d7bf00f71f9f None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:27.110169 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 201/387] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:26 2022] GET /identity/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:27.111463 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371b25c-9cf4-4d69-8622-e086cabddb2c None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:27.241470 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371b25c-9cf4-4d69-8622-e086cabddb2c None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:27.306756 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20a2df-8fbe-4389-b7a9-e162ee721b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:27.307839 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20a2df-8fbe-4389-b7a9-e162ee721b87 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:27.308241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20a2df-8fbe-4389-b7a9-e162ee721b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:27.308685 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20a2df-8fbe-4389-b7a9-e162ee721b87 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:27.315060 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20a2df-8fbe-4389-b7a9-e162ee721b87 None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:27.317484 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20a2df-8fbe-4389-b7a9-e162ee721b87 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:27.321051 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 187/388] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:27 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:27.330029 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12513e3b-10ab-44a1-b026-d7bf00f71f9f None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:27.360005 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20a2df-8fbe-4389-b7a9-e162ee721b87 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:27.413559 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:27.526049 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:27.538533 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12513e3b-10ab-44a1-b026-d7bf00f71f9f None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:27.552111 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20a2df-8fbe-4389-b7a9-e162ee721b87 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:27.596118 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4fc23-7ad2-4581-ab9d-9f375fc3d9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:27.596715 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4fc23-7ad2-4581-ab9d-9f375fc3d9ad None admin] REQUEST_METHOD: `PUT` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:27.596987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4fc23-7ad2-4581-ab9d-9f375fc3d9ad None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:27.597260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4fc23-7ad2-4581-ab9d-9f375fc3d9ad None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1/groups/a32e1cf4ade4453d8c46c9adf07a1c9d/roles/9e1823c929634538b474878b5a80c62d` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:27.600792 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4fc23-7ad2-4581-ab9d-9f375fc3d9ad None admin] RBAC: Authorizing `identity:create_grant(project_id=95d997fd888745edaff8fd28f4d1dde1, group_id=a32e1cf4ade4453d8c46c9adf07a1c9d, role_id=9e1823c929634538b474878b5a80c62d)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:27.604850 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4fc23-7ad2-4581-ab9d-9f375fc3d9ad None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:27.615699 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07669d-1c50-4c0f-a094-3539595a0472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:27.616470 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07669d-1c50-4c0f-a094-3539595a0472 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:27.616757 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07669d-1c50-4c0f-a094-3539595a0472 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:27.617058 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07669d-1c50-4c0f-a094-3539595a0472 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:27.632933 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 202/389] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Aug 23 16:10:27 2022] PUT /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1/groups/a32e1cf4ade4453d8c46c9adf07a1c9d/roles/9e1823c929634538b474878b5a80c62d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:27.635045 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07669d-1c50-4c0f-a094-3539595a0472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-ba07669d-1c50-4c0f-a094-3539595a0472 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:27.640345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:27.641335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:27.642688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 188/390] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:10:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:27.649110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4fc23-7ad2-4581-ab9d-9f375fc3d9ad None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:27.781914 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4fc23-7ad2-4581-ab9d-9f375fc3d9ad None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:27.822714 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c898-1371-4aff-a165-4fcd5918c57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:27.823339 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c898-1371-4aff-a165-4fcd5918c57c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:27.823609 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c898-1371-4aff-a165-4fcd5918c57c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:27.823878 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c898-1371-4aff-a165-4fcd5918c57c None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:27.824623 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56c898-1371-4aff-a165-4fcd5918c57c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:27.824921 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56c898-1371-4aff-a165-4fcd5918c57c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:27.826467 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56c898-1371-4aff-a165-4fcd5918c57c None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:27.837228 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 203/391] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:27.842886 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07669d-1c50-4c0f-a094-3539595a0472 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:27.946592 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:27.961224 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07669d-1c50-4c0f-a094-3539595a0472 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:28.022923 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0305ab0-292e-4f20-b859-5992f761e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:28.024072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0305ab0-292e-4f20-b859-5992f761e627 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:28.024557 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0305ab0-292e-4f20-b859-5992f761e627 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:28.025023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0305ab0-292e-4f20-b859-5992f761e627 None admin] PATH_INFO: `/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:28.026968 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0305ab0-292e-4f20-b859-5992f761e627 None admin] RBAC: Authorizing `identity:get_group(group_id=a32e1cf4ade4453d8c46c9adf07a1c9d)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:28.028868 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0305ab0-292e-4f20-b859-5992f761e627 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:28.032479 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 189/392] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:27 2022] GET /identity/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:28.041717 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c898-1371-4aff-a165-4fcd5918c57c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:28.069287 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:28.208162 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c898-1371-4aff-a165-4fcd5918c57c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:28.252739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409fc1-7f4a-4a64-95fe-c39443c49c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:28.253376 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409fc1-7f4a-4a64-95fe-c39443c49c10 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:28.253745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409fc1-7f4a-4a64-95fe-c39443c49c10 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:28.254043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409fc1-7f4a-4a64-95fe-c39443c49c10 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:28.255204 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c409fc1-7f4a-4a64-95fe-c39443c49c10 None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:28.256756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c409fc1-7f4a-4a64-95fe-c39443c49c10 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:28.262413 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 204/393] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:28 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:28.265314 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0305ab0-292e-4f20-b859-5992f761e627 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:28.381586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0305ab0-292e-4f20-b859-5992f761e627 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:28.423745 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d67d17-d6bc-49be-ba54-23a355e4d383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:28.424407 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d67d17-d6bc-49be-ba54-23a355e4d383 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:28.424678 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d67d17-d6bc-49be-ba54-23a355e4d383 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:28.424947 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d67d17-d6bc-49be-ba54-23a355e4d383 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1/groups/a32e1cf4ade4453d8c46c9adf07a1c9d/roles/d742fa5aed224c11a39ece1d5178d3ca` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:28.427295 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d67d17-d6bc-49be-ba54-23a355e4d383 None admin] RBAC: Authorizing `identity:create_grant(project_id=95d997fd888745edaff8fd28f4d1dde1, group_id=a32e1cf4ade4453d8c46c9adf07a1c9d, role_id=d742fa5aed224c11a39ece1d5178d3ca)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:28.428866 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d67d17-d6bc-49be-ba54-23a355e4d383 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:28.444078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 190/394] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Aug 23 16:10:28 2022] PUT /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1/groups/a32e1cf4ade4453d8c46c9adf07a1c9d/roles/d742fa5aed224c11a39ece1d5178d3ca => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:10:28.865462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202672c7-5ec0-4cfc-8cbe-973adbd6da0d None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:28.865833 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202672c7-5ec0-4cfc-8cbe-973adbd6da0d None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:28.866045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202672c7-5ec0-4cfc-8cbe-973adbd6da0d None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:28.867621 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 205/395] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:28.876753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e1c58-8322-4f2a-b52f-34da53b62025 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:28.876753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e1c58-8322-4f2a-b52f-34da53b62025 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:28.876753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e1c58-8322-4f2a-b52f-34da53b62025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:28.897585 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-bb9e1c58-8322-4f2a-b52f-34da53b62025 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:28.898828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-bb9e1c58-8322-4f2a-b52f-34da53b62025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:28.914460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:28.997955 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 191/396] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:29.174301 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4f0b9-b9d5-41fc-a1ec-a2e102cc77bd None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:29.174912 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4f0b9-b9d5-41fc-a1ec-a2e102cc77bd None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:29.174912 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4f0b9-b9d5-41fc-a1ec-a2e102cc77bd None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:29.176406 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 206/397] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:29.182266 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9763dc-9c0e-44da-923b-a61395b9c696 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:29.182554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9763dc-9c0e-44da-923b-a61395b9c696 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:29.182900 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9763dc-9c0e-44da-923b-a61395b9c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:29.201673 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb52bd9-38d0-4860-bad3-b96669849859 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:29.201972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb52bd9-38d0-4860-bad3-b96669849859 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:29.202404 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb52bd9-38d0-4860-bad3-b96669849859 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:29.204353 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 207/398] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:29.209590 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-af9763dc-9c0e-44da-923b-a61395b9c696 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:29.210197 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67c6e2-e3ca-4a10-baa7-fb04fa122458 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:29.210683 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67c6e2-e3ca-4a10-baa7-fb04fa122458 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:29.210853 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-af9763dc-9c0e-44da-923b-a61395b9c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:29.211311 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67c6e2-e3ca-4a10-baa7-fb04fa122458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:29.248076 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-3a67c6e2-e3ca-4a10-baa7-fb04fa122458 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:29.249286 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-3a67c6e2-e3ca-4a10-baa7-fb04fa122458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:29.320333 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 192/399] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:29.348429 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 208/400] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:29.449127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9763dc-9c0e-44da-923b-a61395b9c696 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:29.564079 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:29.588096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9763dc-9c0e-44da-923b-a61395b9c696 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:29.637065 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa654c4-0cbd-45a7-8d1d-860671ed9f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:29.638105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa654c4-0cbd-45a7-8d1d-860671ed9f68 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:29.638609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa654c4-0cbd-45a7-8d1d-860671ed9f68 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:29.639092 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa654c4-0cbd-45a7-8d1d-860671ed9f68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:29.654812 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa654c4-0cbd-45a7-8d1d-860671ed9f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-4fa654c4-0cbd-45a7-8d1d-860671ed9f68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:29.660241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:29.661222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:29.662100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:29.662100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:29.662100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:29.662100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:29.662100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:29.662100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:29.662100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:29.662100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:29.662100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:29.662100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:29.662100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:29.662100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:29.664349 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 193/401] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:29.671107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67c6e2-e3ca-4a10-baa7-fb04fa122458 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:29.707621 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:29.755178 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa654c4-0cbd-45a7-8d1d-860671ed9f68 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:29.819163 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67c6e2-e3ca-4a10-baa7-fb04fa122458 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:29.863290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448bc60-5db4-419a-abf6-52a1508b5bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:29.864137 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448bc60-5db4-419a-abf6-52a1508b5bc2 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:29.864410 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448bc60-5db4-419a-abf6-52a1508b5bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:29.864739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448bc60-5db4-419a-abf6-52a1508b5bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:29.865406 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448bc60-5db4-419a-abf6-52a1508b5bc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:29.865707 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448bc60-5db4-419a-abf6-52a1508b5bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:29.867232 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448bc60-5db4-419a-abf6-52a1508b5bc2 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:29.878489 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 209/402] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:29.879472 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448bc60-5db4-419a-abf6-52a1508b5bc2 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:29.913743 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa654c4-0cbd-45a7-8d1d-860671ed9f68 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:29.949037 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bfb89-311d-4a4e-af42-2548bc7a6638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:29.950067 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bfb89-311d-4a4e-af42-2548bc7a6638 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:29.950584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bfb89-311d-4a4e-af42-2548bc7a6638 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:29.951056 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bfb89-311d-4a4e-af42-2548bc7a6638 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:29.961249 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:29.965689 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bfb89-311d-4a4e-af42-2548bc7a6638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-564bfb89-311d-4a4e-af42-2548bc7a6638 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:29.972258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:29.973246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:29.974049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:29.974049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:29.974049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:29.974049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:29.974049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:29.974049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:29.974049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:29.974049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:29.974049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:29.974049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:29.974049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:29.974049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:29.974688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 194/403] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:10:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:10:29.978370 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bfb89-311d-4a4e-af42-2548bc7a6638 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:29.984609 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:30.009896 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448bc60-5db4-419a-abf6-52a1508b5bc2 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:30.057897 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76771fe5-b0a9-4dbe-b872-db42120ff472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:30.058783 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76771fe5-b0a9-4dbe-b872-db42120ff472 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:30.059131 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76771fe5-b0a9-4dbe-b872-db42120ff472 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:30.059473 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76771fe5-b0a9-4dbe-b872-db42120ff472 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:30.074412 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76771fe5-b0a9-4dbe-b872-db42120ff472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-76771fe5-b0a9-4dbe-b872-db42120ff472 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:30.083041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:30.084024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:30.084976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:30.084976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:30.084976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:30.084976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:30.084976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:30.084976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:30.084976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:30.084976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:30.084976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:30.084976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:30.084976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:10:30.084976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:30.090050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 210/404] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:10:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:30.091406 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76771fe5-b0a9-4dbe-b872-db42120ff472 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:30.126729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bfb89-311d-4a4e-af42-2548bc7a6638 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:30.187045 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87597e4-4185-48e6-9c1c-41f11c39d895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:30.188517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87597e4-4185-48e6-9c1c-41f11c39d895 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:30.189183 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87597e4-4185-48e6-9c1c-41f11c39d895 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:30.189820 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87597e4-4185-48e6-9c1c-41f11c39d895 None admin] PATH_INFO: `/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:30.191915 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87597e4-4185-48e6-9c1c-41f11c39d895 None admin] RBAC: Authorizing `identity:get_group(group_id=a32e1cf4ade4453d8c46c9adf07a1c9d)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:30.194778 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87597e4-4185-48e6-9c1c-41f11c39d895 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:30.198197 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 195/405] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:29 2022] GET /identity/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:30.199775 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87597e4-4185-48e6-9c1c-41f11c39d895 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:30.237846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76771fe5-b0a9-4dbe-b872-db42120ff472 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:30.288714 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:30.290477 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa2c13-2f7e-4477-b89f-28b44825700a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:30.291125 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa2c13-2f7e-4477-b89f-28b44825700a None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:30.291402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa2c13-2f7e-4477-b89f-28b44825700a None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:30.291673 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa2c13-2f7e-4477-b89f-28b44825700a None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:30.292404 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa2c13-2f7e-4477-b89f-28b44825700a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:30.292999 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa2c13-2f7e-4477-b89f-28b44825700a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:30.295178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa2c13-2f7e-4477-b89f-28b44825700a None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:30.303321 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:30.314493 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 211/406] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:30.314493 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa2c13-2f7e-4477-b89f-28b44825700a None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:30.345072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87597e4-4185-48e6-9c1c-41f11c39d895 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:30.392887 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25944cf0-6005-4fcd-adbb-731e8db0e832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:30.393509 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25944cf0-6005-4fcd-adbb-731e8db0e832 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:30.393788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25944cf0-6005-4fcd-adbb-731e8db0e832 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:30.394135 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25944cf0-6005-4fcd-adbb-731e8db0e832 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:30.394891 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25944cf0-6005-4fcd-adbb-731e8db0e832 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:30.395248 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25944cf0-6005-4fcd-adbb-731e8db0e832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:30.396790 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25944cf0-6005-4fcd-adbb-731e8db0e832 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:30.409051 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 196/407] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:30.419654 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25944cf0-6005-4fcd-adbb-731e8db0e832 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:30.434147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa2c13-2f7e-4477-b89f-28b44825700a None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:30.487091 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a3bdb-fbca-48b6-b176-8f9a7b9e77a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:30.488521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a3bdb-fbca-48b6-b176-8f9a7b9e77a3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:30.489189 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a3bdb-fbca-48b6-b176-8f9a7b9e77a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:30.489841 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a3bdb-fbca-48b6-b176-8f9a7b9e77a3 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:30.491790 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a3bdb-fbca-48b6-b176-8f9a7b9e77a3 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:30.494340 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a3bdb-fbca-48b6-b176-8f9a7b9e77a3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:30.497579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 212/408] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:30 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:30.499217 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a3bdb-fbca-48b6-b176-8f9a7b9e77a3 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:30.582393 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:30.585406 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25944cf0-6005-4fcd-adbb-731e8db0e832 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:30.616224 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:30.620541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a3bdb-fbca-48b6-b176-8f9a7b9e77a3 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:30.623531 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed31260-9b32-4375-bee2-6f8c4fdcae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:30.624513 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed31260-9b32-4375-bee2-6f8c4fdcae30 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:30.624989 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed31260-9b32-4375-bee2-6f8c4fdcae30 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:30.625585 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed31260-9b32-4375-bee2-6f8c4fdcae30 None admin] PATH_INFO: `/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:30.626816 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed31260-9b32-4375-bee2-6f8c4fdcae30 None admin] RBAC: Authorizing `identity:get_group(group_id=a32e1cf4ade4453d8c46c9adf07a1c9d)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:30.628298 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed31260-9b32-4375-bee2-6f8c4fdcae30 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:30.630058 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 197/409] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:30 2022] GET /identity/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:30.630755 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed31260-9b32-4375-bee2-6f8c4fdcae30 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:30.658884 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6001b-97fb-4346-8ba2-0f9c6aadfa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:30.659532 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6001b-97fb-4346-8ba2-0f9c6aadfa41 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:30.659924 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6001b-97fb-4346-8ba2-0f9c6aadfa41 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:30.660194 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6001b-97fb-4346-8ba2-0f9c6aadfa41 None admin] PATH_INFO: `/v3/groups/257a7f4299da4d5f8437a1cb56e891ce` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:30.661418 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6001b-97fb-4346-8ba2-0f9c6aadfa41 None admin] RBAC: Authorizing `identity:get_group(group_id=257a7f4299da4d5f8437a1cb56e891ce)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:30.663368 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6001b-97fb-4346-8ba2-0f9c6aadfa41 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:30.671594 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 213/410] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:30 2022] GET /identity/v3/groups/257a7f4299da4d5f8437a1cb56e891ce => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:30.671594 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e77bcf-3dca-48ec-9380-4077d94a125d None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:30.671594 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e77bcf-3dca-48ec-9380-4077d94a125d None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:30.671594 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e77bcf-3dca-48ec-9380-4077d94a125d None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:30.671594 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 214/411] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:30.671594 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e77bcf-3dca-48ec-9380-4077d94a125d None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:30.746418 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed31260-9b32-4375-bee2-6f8c4fdcae30 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:30.789887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e77bcf-3dca-48ec-9380-4077d94a125d None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:30.793091 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abbcaa-2c3e-4051-b9df-931c0f903f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:30.794519 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abbcaa-2c3e-4051-b9df-931c0f903f88 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:30.794519 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abbcaa-2c3e-4051-b9df-931c0f903f88 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:30.794519 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abbcaa-2c3e-4051-b9df-931c0f903f88 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5/groups/a32e1cf4ade4453d8c46c9adf07a1c9d/roles/9e1823c929634538b474878b5a80c62d` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:30.796249 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abbcaa-2c3e-4051-b9df-931c0f903f88 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e0550c0f8641509cb6701c49c8e0f5, group_id=a32e1cf4ade4453d8c46c9adf07a1c9d, role_id=9e1823c929634538b474878b5a80c62d)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:30.797789 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abbcaa-2c3e-4051-b9df-931c0f903f88 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:30.815515 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 198/412] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Aug 23 16:10:30 2022] PUT /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5/groups/a32e1cf4ade4453d8c46c9adf07a1c9d/roles/9e1823c929634538b474878b5a80c62d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:30.816406 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abbcaa-2c3e-4051-b9df-931c0f903f88 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:30.843010 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9bcf5-66c7-45ae-8229-ae9c7655aefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:30.844077 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9bcf5-66c7-45ae-8229-ae9c7655aefd None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:30.845294 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9bcf5-66c7-45ae-8229-ae9c7655aefd None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:30.845844 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9bcf5-66c7-45ae-8229-ae9c7655aefd None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:30.847717 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9bcf5-66c7-45ae-8229-ae9c7655aefd None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:30.850590 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9bcf5-66c7-45ae-8229-ae9c7655aefd None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:30.853786 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 215/413] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:30 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:30.855822 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71027cc8-94f2-42d4-8f1b-5abee50db1c6 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:30.856262 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71027cc8-94f2-42d4-8f1b-5abee50db1c6 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:30.857084 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71027cc8-94f2-42d4-8f1b-5abee50db1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:30.868238 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:30.885811 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-71027cc8-94f2-42d4-8f1b-5abee50db1c6 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:30.885811 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-71027cc8-94f2-42d4-8f1b-5abee50db1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:30.897495 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:30.949398 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abbcaa-2c3e-4051-b9df-931c0f903f88 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:30.974387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 216/414] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:30.975323 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71027cc8-94f2-42d4-8f1b-5abee50db1c6 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:30.996533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152f1ef-bc43-40c4-9e80-a245f2b78e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:30.997871 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152f1ef-bc43-40c4-9e80-a245f2b78e6d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:30.998416 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152f1ef-bc43-40c4-9e80-a245f2b78e6d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:30.999278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152f1ef-bc43-40c4-9e80-a245f2b78e6d None admin] PATH_INFO: `/v3/projects/295f022ed51d4bed9be5939f17b6ff6c` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:31.000748 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152f1ef-bc43-40c4-9e80-a245f2b78e6d None admin] RBAC: Authorizing `identity:get_project(project_id=295f022ed51d4bed9be5939f17b6ff6c)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:31.002931 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152f1ef-bc43-40c4-9e80-a245f2b78e6d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:31.009685 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 199/415] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:30 2022] GET /identity/v3/projects/295f022ed51d4bed9be5939f17b6ff6c => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:31.009685 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea837215-2267-4924-9e73-4d3776fcb986 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:31.009685 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea837215-2267-4924-9e73-4d3776fcb986 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:31.009685 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea837215-2267-4924-9e73-4d3776fcb986 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:31.009685 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 200/416] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:31.019392 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea837215-2267-4924-9e73-4d3776fcb986 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:31.125985 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71027cc8-94f2-42d4-8f1b-5abee50db1c6 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:31.154150 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea837215-2267-4924-9e73-4d3776fcb986 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:31.178078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a059833-8162-44c2-a446-5ed4315b8a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:31.178803 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a059833-8162-44c2-a446-5ed4315b8a9a None admin] REQUEST_METHOD: `PUT` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:31.179237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a059833-8162-44c2-a446-5ed4315b8a9a None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:31.179685 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a059833-8162-44c2-a446-5ed4315b8a9a None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5/groups/a32e1cf4ade4453d8c46c9adf07a1c9d/roles/d742fa5aed224c11a39ece1d5178d3ca` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:31.183031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a059833-8162-44c2-a446-5ed4315b8a9a None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e0550c0f8641509cb6701c49c8e0f5, group_id=a32e1cf4ade4453d8c46c9adf07a1c9d, role_id=d742fa5aed224c11a39ece1d5178d3ca)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:31.185170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a059833-8162-44c2-a446-5ed4315b8a9a None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:31.188221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:31.195626 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:31.207058 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ddd18-81c1-4e64-b564-6b0aa785e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:31.208177 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ddd18-81c1-4e64-b564-6b0aa785e435 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:31.208666 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ddd18-81c1-4e64-b564-6b0aa785e435 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:31.209237 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ddd18-81c1-4e64-b564-6b0aa785e435 None admin] PATH_INFO: `/v3/projects/295f022ed51d4bed9be5939f17b6ff6c/groups/257a7f4299da4d5f8437a1cb56e891ce/roles/5756384fa8d842139e2f1fc44c5088bd` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:31.211651 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ddd18-81c1-4e64-b564-6b0aa785e435 None admin] RBAC: Authorizing `identity:create_grant(project_id=295f022ed51d4bed9be5939f17b6ff6c, group_id=257a7f4299da4d5f8437a1cb56e891ce, role_id=5756384fa8d842139e2f1fc44c5088bd)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:31.213181 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 217/417] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Aug 23 16:10:30 2022] PUT /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5/groups/a32e1cf4ade4453d8c46c9adf07a1c9d/roles/d742fa5aed224c11a39ece1d5178d3ca => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:31.213668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ddd18-81c1-4e64-b564-6b0aa785e435 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:31.214820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b54fb1-9f28-4369-a715-499ddbc98e43 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:31.215101 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b54fb1-9f28-4369-a715-499ddbc98e43 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:31.215411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b54fb1-9f28-4369-a715-499ddbc98e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:31.246204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 201/418] 10.222.0.47 () {58 vars in 1442 bytes} [Tue Aug 23 16:10:31 2022] PUT /identity/v3/projects/295f022ed51d4bed9be5939f17b6ff6c/groups/257a7f4299da4d5f8437a1cb56e891ce/roles/5756384fa8d842139e2f1fc44c5088bd => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:31.255681 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-35b54fb1-9f28-4369-a715-499ddbc98e43 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:31.257799 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-35b54fb1-9f28-4369-a715-499ddbc98e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:31.321304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ddd18-81c1-4e64-b564-6b0aa785e435 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:31.367293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 218/419] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:31.454595 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ddd18-81c1-4e64-b564-6b0aa785e435 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:31.506522 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a89428-0602-4e0e-ad5f-69ca2bab6055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:31.507104 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a89428-0602-4e0e-ad5f-69ca2bab6055 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:31.507385 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a89428-0602-4e0e-ad5f-69ca2bab6055 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:31.507657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a89428-0602-4e0e-ad5f-69ca2bab6055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:31.522686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a89428-0602-4e0e-ad5f-69ca2bab6055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-06a89428-0602-4e0e-ad5f-69ca2bab6055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:31.528278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:31.529203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:31.530447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 202/420] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:10:31.536293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b54fb1-9f28-4369-a715-499ddbc98e43 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:31.641567 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b54fb1-9f28-4369-a715-499ddbc98e43 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:31.670388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:31.678616 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5060b-3564-4e34-b250-d813cdadba65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:31.679232 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5060b-3564-4e34-b250-d813cdadba65 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:31.679549 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5060b-3564-4e34-b250-d813cdadba65 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:31.679770 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5060b-3564-4e34-b250-d813cdadba65 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:31.680442 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5060b-3564-4e34-b250-d813cdadba65 None admin] RBAC: Adding query filter params (name=member) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:31.680740 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5060b-3564-4e34-b250-d813cdadba65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:31.682161 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5060b-3564-4e34-b250-d813cdadba65 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:31.691622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 219/421] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:31.697658 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a89428-0602-4e0e-ad5f-69ca2bab6055 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:31.745800 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5060b-3564-4e34-b250-d813cdadba65 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:31.766941 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:31.850463 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5060b-3564-4e34-b250-d813cdadba65 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:31.887083 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7a6e5-29c9-435b-b875-8599fd4d3c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:31.887733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7a6e5-29c9-435b-b875-8599fd4d3c3d None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:31.888012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7a6e5-29c9-435b-b875-8599fd4d3c3d None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:31.888283 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7a6e5-29c9-435b-b875-8599fd4d3c3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:31.890813 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a89428-0602-4e0e-ad5f-69ca2bab6055 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:31.900379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7a6e5-29c9-435b-b875-8599fd4d3c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-45f7a6e5-29c9-435b-b875-8599fd4d3c3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:31.906490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:31.907536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:31.908524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 220/422] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:10:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:10:31.914306 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7a6e5-29c9-435b-b875-8599fd4d3c3d None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:31.972424 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:31.973545 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f7a9f-922b-441b-a316-efc4cf012e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:31.974212 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f7a9f-922b-441b-a316-efc4cf012e74 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:31.974490 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f7a9f-922b-441b-a316-efc4cf012e74 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:31.974906 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f7a9f-922b-441b-a316-efc4cf012e74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:32.089280 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7a6e5-29c9-435b-b875-8599fd4d3c3d None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:32.127111 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f7a9f-922b-441b-a316-efc4cf012e74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:32.128608 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f7a9f-922b-441b-a316-efc4cf012e74 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:32.140851 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64772540-0ed7-4d81-a3e2-e17637ed0240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:32.141525 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64772540-0ed7-4d81-a3e2-e17637ed0240 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:32.141808 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64772540-0ed7-4d81-a3e2-e17637ed0240 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:32.142111 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64772540-0ed7-4d81-a3e2-e17637ed0240 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:32.142778 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64772540-0ed7-4d81-a3e2-e17637ed0240 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:32.143081 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64772540-0ed7-4d81-a3e2-e17637ed0240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:32.144466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64772540-0ed7-4d81-a3e2-e17637ed0240 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:32.153836 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 221/423] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:32.159792 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64772540-0ed7-4d81-a3e2-e17637ed0240 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:32.232798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:32.308750 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 203/424] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:32.314496 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f7a9f-922b-441b-a316-efc4cf012e74 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:32.352328 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64772540-0ed7-4d81-a3e2-e17637ed0240 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:32.376549 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:32.424617 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f7a9f-922b-441b-a316-efc4cf012e74 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:32.460830 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91d10a-53bc-4e55-98c2-1b857b20884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:32.461469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91d10a-53bc-4e55-98c2-1b857b20884c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:32.461788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91d10a-53bc-4e55-98c2-1b857b20884c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:32.461972 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91d10a-53bc-4e55-98c2-1b857b20884c None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:32.467538 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91d10a-53bc-4e55-98c2-1b857b20884c None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:32.469194 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91d10a-53bc-4e55-98c2-1b857b20884c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:32.471263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d600648-6f38-4299-9238-6aefb3b94d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:32.471698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 204/425] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:32 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:32.473188 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d600648-6f38-4299-9238-6aefb3b94d9b None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:32.473188 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d600648-6f38-4299-9238-6aefb3b94d9b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:32.473188 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d600648-6f38-4299-9238-6aefb3b94d9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:32.476805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91d10a-53bc-4e55-98c2-1b857b20884c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:32.510417 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:32.615025 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91d10a-53bc-4e55-98c2-1b857b20884c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:32.631294 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d600648-6f38-4299-9238-6aefb3b94d9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:32.632807 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d600648-6f38-4299-9238-6aefb3b94d9b None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:32.657476 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c25b76-b007-4de4-ac71-8b44986e2eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:32.658520 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c25b76-b007-4de4-ac71-8b44986e2eee None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:32.659347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c25b76-b007-4de4-ac71-8b44986e2eee None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:32.659805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c25b76-b007-4de4-ac71-8b44986e2eee None admin] PATH_INFO: `/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:32.661326 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c25b76-b007-4de4-ac71-8b44986e2eee None admin] RBAC: Authorizing `identity:get_group(group_id=a32e1cf4ade4453d8c46c9adf07a1c9d)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:32.663104 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c25b76-b007-4de4-ac71-8b44986e2eee None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:32.665880 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 205/426] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:32 2022] GET /identity/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:32.675406 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c25b76-b007-4de4-ac71-8b44986e2eee None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:32.788944 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:32.812256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c25b76-b007-4de4-ac71-8b44986e2eee None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:32.852591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974b13a-60bf-4ed1-a6cb-933398b13005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:32.853207 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974b13a-60bf-4ed1-a6cb-933398b13005 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:32.853483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974b13a-60bf-4ed1-a6cb-933398b13005 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:32.853751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974b13a-60bf-4ed1-a6cb-933398b13005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:32.854516 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974b13a-60bf-4ed1-a6cb-933398b13005 None admin] RBAC: Adding query filter params (group.id=a32e1cf4ade4453d8c46c9adf07a1c9d, role.id=9e1823c929634538b474878b5a80c62d, scope.project.id=95d997fd888745edaff8fd28f4d1dde1) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:32.854821 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974b13a-60bf-4ed1-a6cb-933398b13005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:32.856265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974b13a-60bf-4ed1-a6cb-933398b13005 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:32.861744 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 222/427] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:32.862957 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 206/428] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 23 16:10:32 2022] GET /identity/v3/role_assignments?group.id=a32e1cf4ade4453d8c46c9adf07a1c9d&scope.project.id=95d997fd888745edaff8fd28f4d1dde1&role.id=9e1823c929634538b474878b5a80c62d => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:32.867460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d600648-6f38-4299-9238-6aefb3b94d9b None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:32.889341 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:33.015306 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d600648-6f38-4299-9238-6aefb3b94d9b None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:33.057689 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f46b3f-78cc-4471-a9c1-2942eb9f18a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:33.058381 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f46b3f-78cc-4471-a9c1-2942eb9f18a0 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:33.058659 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f46b3f-78cc-4471-a9c1-2942eb9f18a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:33.058931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f46b3f-78cc-4471-a9c1-2942eb9f18a0 None admin] PATH_INFO: `/v3/projects/95d997fd888745edaff8fd28f4d1dde1` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:33.060123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f46b3f-78cc-4471-a9c1-2942eb9f18a0 None admin] RBAC: Authorizing `identity:get_project(project_id=95d997fd888745edaff8fd28f4d1dde1)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:33.062214 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f46b3f-78cc-4471-a9c1-2942eb9f18a0 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:33.064105 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 223/429] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:32 2022] GET /identity/v3/projects/95d997fd888745edaff8fd28f4d1dde1 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:33.069941 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974b13a-60bf-4ed1-a6cb-933398b13005 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:33.206101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974b13a-60bf-4ed1-a6cb-933398b13005 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:33.244862 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df33b8-64e6-49f1-8912-6312f7ee8d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:33.245566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df33b8-64e6-49f1-8912-6312f7ee8d14 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:33.245844 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df33b8-64e6-49f1-8912-6312f7ee8d14 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:33.246147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df33b8-64e6-49f1-8912-6312f7ee8d14 None admin] PATH_INFO: `/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:33.247277 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df33b8-64e6-49f1-8912-6312f7ee8d14 None admin] RBAC: Authorizing `identity:get_group(group_id=a32e1cf4ade4453d8c46c9adf07a1c9d)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:33.248722 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df33b8-64e6-49f1-8912-6312f7ee8d14 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:33.250520 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 207/430] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:33 2022] GET /identity/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:33.256170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f46b3f-78cc-4471-a9c1-2942eb9f18a0 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:33.348183 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:33.374391 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f46b3f-78cc-4471-a9c1-2942eb9f18a0 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:33.412032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcede1-ef58-4a83-98bc-339bb98cacc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:33.412692 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcede1-ef58-4a83-98bc-339bb98cacc5 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:33.412967 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcede1-ef58-4a83-98bc-339bb98cacc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:33.413236 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcede1-ef58-4a83-98bc-339bb98cacc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:33.413968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcede1-ef58-4a83-98bc-339bb98cacc5 None admin] RBAC: Adding query filter params (group.id=a32e1cf4ade4453d8c46c9adf07a1c9d, role.id=d742fa5aed224c11a39ece1d5178d3ca, scope.project.id=95d997fd888745edaff8fd28f4d1dde1) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:33.414313 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcede1-ef58-4a83-98bc-339bb98cacc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:33.415751 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcede1-ef58-4a83-98bc-339bb98cacc5 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:33.422526 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 224/431] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 23 16:10:33 2022] GET /identity/v3/role_assignments?group.id=a32e1cf4ade4453d8c46c9adf07a1c9d&scope.project.id=95d997fd888745edaff8fd28f4d1dde1&role.id=d742fa5aed224c11a39ece1d5178d3ca => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:33.644134 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319498e1-1a7e-4607-883f-c9af6d0e4c2c None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:33.644134 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319498e1-1a7e-4607-883f-c9af6d0e4c2c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:33.644134 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319498e1-1a7e-4607-883f-c9af6d0e4c2c None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:33.644859 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 208/432] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:33.651252 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53b70-2a70-4778-a604-b6ee4056d1cd None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:33.651618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53b70-2a70-4778-a604-b6ee4056d1cd None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:33.651952 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53b70-2a70-4778-a604-b6ee4056d1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:33.672403 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-13d53b70-2a70-4778-a604-b6ee4056d1cd None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:33.673915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-13d53b70-2a70-4778-a604-b6ee4056d1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:33.760064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 225/433] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:33.894688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c1ad5-1653-41d6-bb03-45c50c9f03e2 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:33.895011 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c1ad5-1653-41d6-bb03-45c50c9f03e2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:33.895230 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c1ad5-1653-41d6-bb03-45c50c9f03e2 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:33.896855 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 209/434] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:33.902464 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12437753-a094-4be8-ad6a-536bac2fb6df None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:33.902747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12437753-a094-4be8-ad6a-536bac2fb6df None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:33.903019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12437753-a094-4be8-ad6a-536bac2fb6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:33.922768 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-12437753-a094-4be8-ad6a-536bac2fb6df None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:33.924294 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-12437753-a094-4be8-ad6a-536bac2fb6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:33.932689 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dfce2-b054-41fd-aaab-64d29fc80f59 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:33.933297 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dfce2-b054-41fd-aaab-64d29fc80f59 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:33.933761 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dfce2-b054-41fd-aaab-64d29fc80f59 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:33.935788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 210/435] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:33.940699 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01f1e0-b59a-4f73-b141-565e418e7641 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:33.940962 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01f1e0-b59a-4f73-b141-565e418e7641 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:33.941235 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01f1e0-b59a-4f73-b141-565e418e7641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:33.963243 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-4e01f1e0-b59a-4f73-b141-565e418e7641 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:33.964467 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-4e01f1e0-b59a-4f73-b141-565e418e7641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:33.979277 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:33.998919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:34.004562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 226/436] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:34.044172 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 211/437] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:34.102843 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12437753-a094-4be8-ad6a-536bac2fb6df None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:34.208759 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12437753-a094-4be8-ad6a-536bac2fb6df None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:34.244236 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d81cc5-53ef-4b89-a380-e2e2d5bfe662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:34.245168 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d81cc5-53ef-4b89-a380-e2e2d5bfe662 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:34.245629 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d81cc5-53ef-4b89-a380-e2e2d5bfe662 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:34.246097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d81cc5-53ef-4b89-a380-e2e2d5bfe662 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:34.256881 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d81cc5-53ef-4b89-a380-e2e2d5bfe662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-22d81cc5-53ef-4b89-a380-e2e2d5bfe662 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:34.261909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:34.262902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:34.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:34.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:34.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:34.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:34.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:34.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:34.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:34.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:34.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:34.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:34.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:10:34.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:34.266050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 227/438] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:34.270536 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01f1e0-b59a-4f73-b141-565e418e7641 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:34.324392 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d81cc5-53ef-4b89-a380-e2e2d5bfe662 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:34.374624 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01f1e0-b59a-4f73-b141-565e418e7641 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:34.392386 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:34.409402 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb6279-8625-429d-878d-8210b3dc43a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:34.410029 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6279-8625-429d-878d-8210b3dc43a4 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:34.410314 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6279-8625-429d-878d-8210b3dc43a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:34.410587 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6279-8625-429d-878d-8210b3dc43a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:34.411249 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb6279-8625-429d-878d-8210b3dc43a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:34.411549 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb6279-8625-429d-878d-8210b3dc43a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:34.412957 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb6279-8625-429d-878d-8210b3dc43a4 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:34.421109 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 212/439] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:10:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:34.421907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb6279-8625-429d-878d-8210b3dc43a4 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:34.433340 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:34.435017 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d81cc5-53ef-4b89-a380-e2e2d5bfe662 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:34.469362 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeb2c7-16fe-4389-8c1d-66a5d33dcfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:34.469987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb2c7-16fe-4389-8c1d-66a5d33dcfcc None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:34.470286 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb2c7-16fe-4389-8c1d-66a5d33dcfcc None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:34.470556 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb2c7-16fe-4389-8c1d-66a5d33dcfcc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:34.481151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeb2c7-16fe-4389-8c1d-66a5d33dcfcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-5ceeb2c7-16fe-4389-8c1d-66a5d33dcfcc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:34.485903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:34.486824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:34.487622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 228/440] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:10:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:34.488272 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeb2c7-16fe-4389-8c1d-66a5d33dcfcc None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:34.528254 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb6279-8625-429d-878d-8210b3dc43a4 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:34.561548 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692278c-44a2-48fc-ad73-a60ae7fb326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:34.562206 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692278c-44a2-48fc-ad73-a60ae7fb326c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:34.562485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692278c-44a2-48fc-ad73-a60ae7fb326c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:34.562757 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692278c-44a2-48fc-ad73-a60ae7fb326c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:34.573479 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692278c-44a2-48fc-ad73-a60ae7fb326c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-f692278c-44a2-48fc-ad73-a60ae7fb326c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:34.578828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:34.579711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:34.580529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 213/441] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:34.581185 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692278c-44a2-48fc-ad73-a60ae7fb326c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:34.591362 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeb2c7-16fe-4389-8c1d-66a5d33dcfcc None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:34.612332 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:34.627056 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a07e9e-01ab-4ce8-bc0d-f6fdefc9cf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:34.627663 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a07e9e-01ab-4ce8-bc0d-f6fdefc9cf43 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:34.627930 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a07e9e-01ab-4ce8-bc0d-f6fdefc9cf43 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:34.628187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a07e9e-01ab-4ce8-bc0d-f6fdefc9cf43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:34.653839 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:34.689897 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692278c-44a2-48fc-ad73-a60ae7fb326c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:34.701250 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a07e9e-01ab-4ce8-bc0d-f6fdefc9cf43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:34.702770 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a07e9e-01ab-4ce8-bc0d-f6fdefc9cf43 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:34.724506 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2e503-1343-4db7-ae11-5044df8e4f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:34.725211 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e503-1343-4db7-ae11-5044df8e4f01 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:34.725487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e503-1343-4db7-ae11-5044df8e4f01 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:34.725766 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e503-1343-4db7-ae11-5044df8e4f01 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:34.726472 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2e503-1343-4db7-ae11-5044df8e4f01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:34.726778 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2e503-1343-4db7-ae11-5044df8e4f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:34.728169 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2e503-1343-4db7-ae11-5044df8e4f01 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:34.736439 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 214/442] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:34.737237 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2e503-1343-4db7-ae11-5044df8e4f01 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:34.802229 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 229/443] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:34.803168 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a07e9e-01ab-4ce8-bc0d-f6fdefc9cf43 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:34.827365 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:34.844829 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2e503-1343-4db7-ae11-5044df8e4f01 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:34.871074 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:34.879890 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788093c8-12df-4507-8d37-1a603831ca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:34.880490 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788093c8-12df-4507-8d37-1a603831ca51 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:34.880761 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788093c8-12df-4507-8d37-1a603831ca51 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:34.881064 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788093c8-12df-4507-8d37-1a603831ca51 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:34.881860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788093c8-12df-4507-8d37-1a603831ca51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:34.882195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788093c8-12df-4507-8d37-1a603831ca51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:34.883566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788093c8-12df-4507-8d37-1a603831ca51 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:34.892045 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 215/444] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:34.894145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788093c8-12df-4507-8d37-1a603831ca51 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:34.911276 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a07e9e-01ab-4ce8-bc0d-f6fdefc9cf43 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:34.946915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b085504-8c48-4c53-b50e-a7e0a3941832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:34.947638 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085504-8c48-4c53-b50e-a7e0a3941832 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:34.947914 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085504-8c48-4c53-b50e-a7e0a3941832 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:34.948188 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085504-8c48-4c53-b50e-a7e0a3941832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:34.991650 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788093c8-12df-4507-8d37-1a603831ca51 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:35.014845 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b085504-8c48-4c53-b50e-a7e0a3941832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:35.016322 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b085504-8c48-4c53-b50e-a7e0a3941832 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:35.025224 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07ca6d-057f-431f-af34-a56fd49c574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:35.025854 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07ca6d-057f-431f-af34-a56fd49c574a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:35.026190 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07ca6d-057f-431f-af34-a56fd49c574a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:35.026475 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07ca6d-057f-431f-af34-a56fd49c574a None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:35.027582 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07ca6d-057f-431f-af34-a56fd49c574a None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:35.029053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07ca6d-057f-431f-af34-a56fd49c574a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:35.030683 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 216/445] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:34 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:35.031768 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07ca6d-057f-431f-af34-a56fd49c574a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:35.037727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:35.091791 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:35.120438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 230/446] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:35.121214 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b085504-8c48-4c53-b50e-a7e0a3941832 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:35.140228 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07ca6d-057f-431f-af34-a56fd49c574a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:35.174758 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048eb94-2a40-446e-b42d-4c31012396a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:35.175335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048eb94-2a40-446e-b42d-4c31012396a7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:35.175622 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048eb94-2a40-446e-b42d-4c31012396a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:35.175886 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048eb94-2a40-446e-b42d-4c31012396a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:35.236728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b085504-8c48-4c53-b50e-a7e0a3941832 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:35.246535 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048eb94-2a40-446e-b42d-4c31012396a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:35.248023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048eb94-2a40-446e-b42d-4c31012396a7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:35.259527 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:35.274485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1aed-019e-4546-8e71-9b617afb9f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:35.275114 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1aed-019e-4546-8e71-9b617afb9f22 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:35.275402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1aed-019e-4546-8e71-9b617afb9f22 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:35.275662 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1aed-019e-4546-8e71-9b617afb9f22 None admin] PATH_INFO: `/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:35.276787 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e1aed-019e-4546-8e71-9b617afb9f22 None admin] RBAC: Authorizing `identity:get_group(group_id=a32e1cf4ade4453d8c46c9adf07a1c9d)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:35.278227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e1aed-019e-4546-8e71-9b617afb9f22 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:35.279810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 231/447] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:35 2022] GET /identity/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:35.280563 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1aed-019e-4546-8e71-9b617afb9f22 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:35.314662 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:35.356508 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 217/448] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:35.357348 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048eb94-2a40-446e-b42d-4c31012396a7 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:35.391320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1aed-019e-4546-8e71-9b617afb9f22 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:35.425676 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0a1b2-5e48-486e-9dea-f5bf972436f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:35.426420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0a1b2-5e48-486e-9dea-f5bf972436f3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:35.426597 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0a1b2-5e48-486e-9dea-f5bf972436f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:35.426862 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0a1b2-5e48-486e-9dea-f5bf972436f3 None admin] PATH_INFO: `/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:35.428033 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0a1b2-5e48-486e-9dea-f5bf972436f3 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e0550c0f8641509cb6701c49c8e0f5)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:35.429462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0a1b2-5e48-486e-9dea-f5bf972436f3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:35.431129 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 232/449] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:35 2022] GET /identity/v3/projects/f3e0550c0f8641509cb6701c49c8e0f5 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:35.431877 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0a1b2-5e48-486e-9dea-f5bf972436f3 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:35.461561 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048eb94-2a40-446e-b42d-4c31012396a7 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:35.487359 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:35.496014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993f667-13e8-4318-91f4-59509780d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:35.496629 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993f667-13e8-4318-91f4-59509780d8bd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:35.496908 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993f667-13e8-4318-91f4-59509780d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:35.497179 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993f667-13e8-4318-91f4-59509780d8bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:35.498389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993f667-13e8-4318-91f4-59509780d8bd None admin] RBAC: Adding query filter params (group.id=a32e1cf4ade4453d8c46c9adf07a1c9d, role.id=9e1823c929634538b474878b5a80c62d, scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:35.498389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993f667-13e8-4318-91f4-59509780d8bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:35.499682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993f667-13e8-4318-91f4-59509780d8bd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:35.509530 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 218/450] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 23 16:10:35 2022] GET /identity/v3/role_assignments?group.id=a32e1cf4ade4453d8c46c9adf07a1c9d&scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5&role.id=9e1823c929634538b474878b5a80c62d => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:35.509530 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993f667-13e8-4318-91f4-59509780d8bd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:35.536399 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:35.546759 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0a1b2-5e48-486e-9dea-f5bf972436f3 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:35.585599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2bf66-8bcb-4e27-b319-ca971ab2e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:35.586645 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2bf66-8bcb-4e27-b319-ca971ab2e32d None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:35.586915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2bf66-8bcb-4e27-b319-ca971ab2e32d None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:35.587184 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2bf66-8bcb-4e27-b319-ca971ab2e32d None admin] PATH_INFO: `/v3/projects/295f022ed51d4bed9be5939f17b6ff6c` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:35.588402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2bf66-8bcb-4e27-b319-ca971ab2e32d None admin] RBAC: Authorizing `identity:get_project(project_id=295f022ed51d4bed9be5939f17b6ff6c)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:35.589870 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2bf66-8bcb-4e27-b319-ca971ab2e32d None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:35.591618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 233/451] 10.222.0.47 () {56 vars in 1186 bytes} [Tue Aug 23 16:10:35 2022] GET /identity/v3/projects/295f022ed51d4bed9be5939f17b6ff6c => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:35.597375 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2bf66-8bcb-4e27-b319-ca971ab2e32d None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:35.640853 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993f667-13e8-4318-91f4-59509780d8bd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:35.679467 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bcc0b-b33d-433f-8b94-34152493a932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:35.680204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bcc0b-b33d-433f-8b94-34152493a932 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:35.680477 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bcc0b-b33d-433f-8b94-34152493a932 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:35.680743 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bcc0b-b33d-433f-8b94-34152493a932 None admin] PATH_INFO: `/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:35.682031 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bcc0b-b33d-433f-8b94-34152493a932 None admin] RBAC: Authorizing `identity:get_group(group_id=a32e1cf4ade4453d8c46c9adf07a1c9d)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:35.683459 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bcc0b-b33d-433f-8b94-34152493a932 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:35.689790 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 219/452] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:35 2022] GET /identity/v3/groups/a32e1cf4ade4453d8c46c9adf07a1c9d => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:35.691388 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bcc0b-b33d-433f-8b94-34152493a932 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:35.722783 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2bf66-8bcb-4e27-b319-ca971ab2e32d None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:35.749125 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:35.762229 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be470244-1452-4d3c-9cc7-e1f22624fd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:35.763367 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be470244-1452-4d3c-9cc7-e1f22624fd62 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:35.763367 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be470244-1452-4d3c-9cc7-e1f22624fd62 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:35.763367 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be470244-1452-4d3c-9cc7-e1f22624fd62 None admin] PATH_INFO: `/v3/groups/257a7f4299da4d5f8437a1cb56e891ce` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:35.764528 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be470244-1452-4d3c-9cc7-e1f22624fd62 None admin] RBAC: Authorizing `identity:get_group(group_id=257a7f4299da4d5f8437a1cb56e891ce)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:35.765983 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be470244-1452-4d3c-9cc7-e1f22624fd62 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:35.767601 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 234/453] 10.222.0.47 () {56 vars in 1180 bytes} [Tue Aug 23 16:10:35 2022] GET /identity/v3/groups/257a7f4299da4d5f8437a1cb56e891ce => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:35.773932 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be470244-1452-4d3c-9cc7-e1f22624fd62 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:35.802526 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:35.816725 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bcc0b-b33d-433f-8b94-34152493a932 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:35.857089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704c73f-33c7-4daf-91ac-e67a7a6e22a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:35.857709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704c73f-33c7-4daf-91ac-e67a7a6e22a2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:35.857986 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704c73f-33c7-4daf-91ac-e67a7a6e22a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:35.858302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704c73f-33c7-4daf-91ac-e67a7a6e22a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:35.859042 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704c73f-33c7-4daf-91ac-e67a7a6e22a2 None admin] RBAC: Adding query filter params (group.id=a32e1cf4ade4453d8c46c9adf07a1c9d, role.id=d742fa5aed224c11a39ece1d5178d3ca, scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:35.859336 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704c73f-33c7-4daf-91ac-e67a7a6e22a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:35.860780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704c73f-33c7-4daf-91ac-e67a7a6e22a2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:35.870636 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 220/454] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 23 16:10:35 2022] GET /identity/v3/role_assignments?group.id=a32e1cf4ade4453d8c46c9adf07a1c9d&scope.project.id=f3e0550c0f8641509cb6701c49c8e0f5&role.id=d742fa5aed224c11a39ece1d5178d3ca => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:35.889248 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be470244-1452-4d3c-9cc7-e1f22624fd62 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:35.931213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332b083-0690-4249-b4cf-75e488335646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:35.931749 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332b083-0690-4249-b4cf-75e488335646 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:35.932029 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332b083-0690-4249-b4cf-75e488335646 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:35.932298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332b083-0690-4249-b4cf-75e488335646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:35.933116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332b083-0690-4249-b4cf-75e488335646 None admin] RBAC: Adding query filter params (group.id=257a7f4299da4d5f8437a1cb56e891ce, role.id=5756384fa8d842139e2f1fc44c5088bd, scope.project.id=295f022ed51d4bed9be5939f17b6ff6c) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:35.933431 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332b083-0690-4249-b4cf-75e488335646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:35.934971 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332b083-0690-4249-b4cf-75e488335646 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:35.942503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 235/455] 10.222.0.47 () {56 vars in 1376 bytes} [Tue Aug 23 16:10:35 2022] GET /identity/v3/role_assignments?group.id=257a7f4299da4d5f8437a1cb56e891ce&scope.project.id=295f022ed51d4bed9be5939f17b6ff6c&role.id=5756384fa8d842139e2f1fc44c5088bd => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:38.491086 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed8e56-1429-4e74-aaba-c1638bca43c5 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:38.491624 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed8e56-1429-4e74-aaba-c1638bca43c5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:38.491624 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed8e56-1429-4e74-aaba-c1638bca43c5 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:38.492969 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 221/456] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:38.498680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4fbbd-bb99-4df5-ab9a-361963d0b696 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:38.499058 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4fbbd-bb99-4df5-ab9a-361963d0b696 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:38.499245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4fbbd-bb99-4df5-ab9a-361963d0b696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:38.522943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-f5c4fbbd-bb99-4df5-ab9a-361963d0b696 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:38.524165 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-f5c4fbbd-bb99-4df5-ab9a-361963d0b696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:38.578301 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:38.597891 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 236/457] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:38.758707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87648e-52fe-40d6-91ca-607ecbc16c8f None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:38.758879 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87648e-52fe-40d6-91ca-607ecbc16c8f None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:38.759147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87648e-52fe-40d6-91ca-607ecbc16c8f None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:38.760777 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 222/458] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:38.766068 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93c981-2a82-4792-90cd-50850a4a2883 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:38.766349 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93c981-2a82-4792-90cd-50850a4a2883 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:38.766619 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93c981-2a82-4792-90cd-50850a4a2883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:38.786018 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-3f93c981-2a82-4792-90cd-50850a4a2883 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:38.787233 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-3f93c981-2a82-4792-90cd-50850a4a2883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:38.819832 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1bb65-5627-472f-b6a5-e406ef6df732 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:38.820149 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1bb65-5627-472f-b6a5-e406ef6df732 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:38.820390 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1bb65-5627-472f-b6a5-e406ef6df732 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:38.821973 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 223/459] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:38.827305 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ed9f2-3d7a-4a41-b8d6-3c73b2187584 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:38.827578 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ed9f2-3d7a-4a41-b8d6-3c73b2187584 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:38.827842 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ed9f2-3d7a-4a41-b8d6-3c73b2187584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:38.850655 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-ed8ed9f2-3d7a-4a41-b8d6-3c73b2187584 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:38.852313 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-ed8ed9f2-3d7a-4a41-b8d6-3c73b2187584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:38.859300 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 237/460] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:38.925323 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93c981-2a82-4792-90cd-50850a4a2883 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:38.932613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 224/461] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:39.044967 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93c981-2a82-4792-90cd-50850a4a2883 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:39.062210 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:39.081812 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292e64c-1dcf-4483-88fe-0945943bbba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:39.082479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292e64c-1dcf-4483-88fe-0945943bbba8 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:39.082749 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292e64c-1dcf-4483-88fe-0945943bbba8 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:39.083016 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292e64c-1dcf-4483-88fe-0945943bbba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:39.094536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292e64c-1dcf-4483-88fe-0945943bbba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:39.104784 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292e64c-1dcf-4483-88fe-0945943bbba8 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-5292e64c-1dcf-4483-88fe-0945943bbba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:39.121846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:39.122839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:39.123699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:39.123699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:39.123699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:39.123699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 238/462] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:39.130302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ed9f2-3d7a-4a41-b8d6-3c73b2187584 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:39.135010 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b1b8-1e16-4abd-960e-18d6093cdfd9 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:39.135292 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b1b8-1e16-4abd-960e-18d6093cdfd9 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:39.135567 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b1b8-1e16-4abd-960e-18d6093cdfd9 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:39.137014 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 239/463] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:39.142052 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a82a2-e14d-43a8-b790-ed7824fc7a9b None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:39.142340 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a82a2-e14d-43a8-b790-ed7824fc7a9b None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:39.142615 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a82a2-e14d-43a8-b790-ed7824fc7a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:39.160777 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-436a82a2-e14d-43a8-b790-ed7824fc7a9b None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:39.161981 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-436a82a2-e14d-43a8-b790-ed7824fc7a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:39.226116 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:39.234134 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 240/464] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:39.236144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a82a2-e14d-43a8-b790-ed7824fc7a9b None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:39.245696 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ed9f2-3d7a-4a41-b8d6-3c73b2187584 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:39.287174 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f726-9e2f-41ab-8f4b-8c18fe30e3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:39.287828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f726-9e2f-41ab-8f4b-8c18fe30e3a2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:39.288096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f726-9e2f-41ab-8f4b-8c18fe30e3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:39.288358 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f726-9e2f-41ab-8f4b-8c18fe30e3a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:39.288994 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7f726-9e2f-41ab-8f4b-8c18fe30e3a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:39.289287 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7f726-9e2f-41ab-8f4b-8c18fe30e3a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:39.290682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7f726-9e2f-41ab-8f4b-8c18fe30e3a2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:39.313596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 225/465] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:39.313596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f726-9e2f-41ab-8f4b-8c18fe30e3a2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:39.346912 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:39.353279 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a82a2-e14d-43a8-b790-ed7824fc7a9b None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:39.389279 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568efde1-3b2f-4338-92c8-b6185f6a3bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:39.389911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568efde1-3b2f-4338-92c8-b6185f6a3bf2 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:39.390228 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568efde1-3b2f-4338-92c8-b6185f6a3bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:39.390495 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568efde1-3b2f-4338-92c8-b6185f6a3bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:39.401202 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568efde1-3b2f-4338-92c8-b6185f6a3bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:39.402688 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568efde1-3b2f-4338-92c8-b6185f6a3bf2 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-568efde1-3b2f-4338-92c8-b6185f6a3bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:39.417931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:39.419146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:39.420096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:39.420096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:39.420096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:39.420096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 241/466] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:39.422851 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f726-9e2f-41ab-8f4b-8c18fe30e3a2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:39.424641 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568efde1-3b2f-4338-92c8-b6185f6a3bf2 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:39.460780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79950749-908e-4503-b292-f11e10d32592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:39.460980 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79950749-908e-4503-b292-f11e10d32592 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:39.461186 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79950749-908e-4503-b292-f11e10d32592 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:39.461430 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79950749-908e-4503-b292-f11e10d32592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:39.472047 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79950749-908e-4503-b292-f11e10d32592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:39.474117 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79950749-908e-4503-b292-f11e10d32592 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:39.477804 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-79950749-908e-4503-b292-f11e10d32592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:39.493424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:39.494856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:39.495693 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:39.495693 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:39.495693 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:39.495693 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 226/467] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:39.495693 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79950749-908e-4503-b292-f11e10d32592 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:39.536636 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568efde1-3b2f-4338-92c8-b6185f6a3bf2 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:39.574037 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7984374-05a6-44fa-b505-a2434644aedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:39.574578 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7984374-05a6-44fa-b505-a2434644aedb None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:39.574853 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7984374-05a6-44fa-b505-a2434644aedb None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:39.575098 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7984374-05a6-44fa-b505-a2434644aedb None admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:39.575732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7984374-05a6-44fa-b505-a2434644aedb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:39.577179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7984374-05a6-44fa-b505-a2434644aedb None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:39.598071 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 242/468] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 23 16:10:39 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:10:39.598974 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7984374-05a6-44fa-b505-a2434644aedb None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:39.606860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79950749-908e-4503-b292-f11e10d32592 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:39.622415 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:39.652398 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44486305-6510-4f41-9a69-5ded60f15c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:39.653030 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44486305-6510-4f41-9a69-5ded60f15c80 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:39.653304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44486305-6510-4f41-9a69-5ded60f15c80 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:39.653567 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44486305-6510-4f41-9a69-5ded60f15c80 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:39.654311 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44486305-6510-4f41-9a69-5ded60f15c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:39.654611 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44486305-6510-4f41-9a69-5ded60f15c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:39.657114 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44486305-6510-4f41-9a69-5ded60f15c80 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:39.676695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 227/469] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:39.677782 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44486305-6510-4f41-9a69-5ded60f15c80 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:39.729914 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7984374-05a6-44fa-b505-a2434644aedb None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:39.746134 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:39.772114 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197a221-aae5-4a5f-80f7-1b1a2b3ee26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:39.773368 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197a221-aae5-4a5f-80f7-1b1a2b3ee26f None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:39.773831 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197a221-aae5-4a5f-80f7-1b1a2b3ee26f None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:39.774113 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197a221-aae5-4a5f-80f7-1b1a2b3ee26f None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:39.774769 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197a221-aae5-4a5f-80f7-1b1a2b3ee26f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:39.775069 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197a221-aae5-4a5f-80f7-1b1a2b3ee26f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:39.776448 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197a221-aae5-4a5f-80f7-1b1a2b3ee26f None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:39.792803 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 243/470] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:39.794081 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197a221-aae5-4a5f-80f7-1b1a2b3ee26f None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:39.802950 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44486305-6510-4f41-9a69-5ded60f15c80 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:39.846536 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da782b42-340e-4b1c-8b17-b6dd95cb238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:39.847404 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da782b42-340e-4b1c-8b17-b6dd95cb238d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:39.847679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da782b42-340e-4b1c-8b17-b6dd95cb238d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:39.848086 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da782b42-340e-4b1c-8b17-b6dd95cb238d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:39.858870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da782b42-340e-4b1c-8b17-b6dd95cb238d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:39.860340 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da782b42-340e-4b1c-8b17-b6dd95cb238d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:39.871554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-da782b42-340e-4b1c-8b17-b6dd95cb238d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:39.875877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:39.876793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:39.878372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:39.878372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:39.878372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:39.878372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 228/471] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:39.878372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da782b42-340e-4b1c-8b17-b6dd95cb238d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:39.917842 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197a221-aae5-4a5f-80f7-1b1a2b3ee26f None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:39.958955 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94278dcc-f57a-4d60-9c6a-404c6152f0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:39.959599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94278dcc-f57a-4d60-9c6a-404c6152f0c6 None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:39.959878 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94278dcc-f57a-4d60-9c6a-404c6152f0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:39.960150 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94278dcc-f57a-4d60-9c6a-404c6152f0c6 None admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:39.960807 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94278dcc-f57a-4d60-9c6a-404c6152f0c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:39.962284 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94278dcc-f57a-4d60-9c6a-404c6152f0c6 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:39.985339 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 244/472] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 23 16:10:39 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:10:39.986261 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94278dcc-f57a-4d60-9c6a-404c6152f0c6 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:40.001232 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da782b42-340e-4b1c-8b17-b6dd95cb238d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:40.014235 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:40.047807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1c24b-9c49-4053-9d79-02c8ee07945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:40.048803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1c24b-9c49-4053-9d79-02c8ee07945b None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:40.049283 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1c24b-9c49-4053-9d79-02c8ee07945b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:40.049847 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1c24b-9c49-4053-9d79-02c8ee07945b None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:40.050895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1c24b-9c49-4053-9d79-02c8ee07945b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:40.052792 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1c24b-9c49-4053-9d79-02c8ee07945b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:40.082330 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 229/473] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 23 16:10:39 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:10:40.124584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94278dcc-f57a-4d60-9c6a-404c6152f0c6 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:40.159992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:40.171037 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c623dfe-9824-472f-9a2e-f62b48d52a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:40.171695 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c623dfe-9824-472f-9a2e-f62b48d52a55 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:40.172354 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c623dfe-9824-472f-9a2e-f62b48d52a55 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:40.172770 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c623dfe-9824-472f-9a2e-f62b48d52a55 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:40.173329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c623dfe-9824-472f-9a2e-f62b48d52a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:40.174885 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c623dfe-9824-472f-9a2e-f62b48d52a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:40.176909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c623dfe-9824-472f-9a2e-f62b48d52a55 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:40.191766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 245/474] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:40.197844 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1c24b-9c49-4053-9d79-02c8ee07945b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:40.318920 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1c24b-9c49-4053-9d79-02c8ee07945b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:40.355510 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f78364-1b43-4b6a-a207-d7e12e16c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:40.356135 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f78364-1b43-4b6a-a207-d7e12e16c61a None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:40.356413 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f78364-1b43-4b6a-a207-d7e12e16c61a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:40.356780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f78364-1b43-4b6a-a207-d7e12e16c61a None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:40.357442 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f78364-1b43-4b6a-a207-d7e12e16c61a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:40.358933 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f78364-1b43-4b6a-a207-d7e12e16c61a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:40.383022 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 230/475] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 23 16:10:40 2022] POST /identity/v3/users => generated 249 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:10:41.856508 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe93aa6-bfea-4776-a267-42ade41dca5a None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:41.857503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe93aa6-bfea-4776-a267-42ade41dca5a None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:41.857968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe93aa6-bfea-4776-a267-42ade41dca5a None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:41.859759 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 246/476] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:41.865542 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72191e06-d434-4c58-bd76-4dd6fd953ec9 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:41.866536 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72191e06-d434-4c58-bd76-4dd6fd953ec9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:41.867032 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72191e06-d434-4c58-bd76-4dd6fd953ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:41.885826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-72191e06-d434-4c58-bd76-4dd6fd953ec9 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:41.887362 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-72191e06-d434-4c58-bd76-4dd6fd953ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:41.902883 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:41.977886 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 231/477] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:42.296344 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c688e-c548-4263-8be8-b9d22acc184b None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:42.296865 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c688e-c548-4263-8be8-b9d22acc184b None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:42.297353 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c688e-c548-4263-8be8-b9d22acc184b None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:42.299286 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 247/478] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:42.305203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f1fd9-d1bc-477e-a958-11d6d315e6bd None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:42.305489 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f1fd9-d1bc-477e-a958-11d6d315e6bd None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:42.305753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f1fd9-d1bc-477e-a958-11d6d315e6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:42.314643 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c688e-c548-4263-8be8-b9d22acc184b None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:42.326127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-4e5f1fd9-d1bc-477e-a958-11d6d315e6bd None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:42.327830 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-4e5f1fd9-d1bc-477e-a958-11d6d315e6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:42.419002 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 232/479] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:42.431700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c688e-c548-4263-8be8-b9d22acc184b None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:42.445266 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f032e-558b-4443-87fd-9f403be12341 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:42.445583 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f032e-558b-4443-87fd-9f403be12341 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:42.445803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f032e-558b-4443-87fd-9f403be12341 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:42.448152 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 233/480] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:42.453242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5275e-4f00-4d76-bcaa-7bf186889f72 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:42.453515 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5275e-4f00-4d76-bcaa-7bf186889f72 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:42.453786 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5275e-4f00-4d76-bcaa-7bf186889f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:42.472375 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-20c5275e-4f00-4d76-bcaa-7bf186889f72 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:42.473587 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-20c5275e-4f00-4d76-bcaa-7bf186889f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:42.476459 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c1d5-9fea-4aab-9242-8cd6c5a0cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:42.478264 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c1d5-9fea-4aab-9242-8cd6c5a0cb5c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:42.478773 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c1d5-9fea-4aab-9242-8cd6c5a0cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:42.479588 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c1d5-9fea-4aab-9242-8cd6c5a0cb5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:42.495440 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684c1d5-9fea-4aab-9242-8cd6c5a0cb5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-1684c1d5-9fea-4aab-9242-8cd6c5a0cb5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:42.502757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:42.503700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:42.505039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:42.505039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:42.505039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:42.505039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:42.505039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:42.505039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:42.505039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:42.505039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:42.505039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:42.505039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:42.505039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:42.505039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:42.508163 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 248/481] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:10:42.513811 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c1d5-9fea-4aab-9242-8cd6c5a0cb5c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:42.562771 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:42.581818 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 234/482] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:42.628901 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c1d5-9fea-4aab-9242-8cd6c5a0cb5c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:42.664980 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac48e4c-475b-4466-9630-144e0748fc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:42.665590 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac48e4c-475b-4466-9630-144e0748fc43 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:42.665866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac48e4c-475b-4466-9630-144e0748fc43 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:42.666171 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac48e4c-475b-4466-9630-144e0748fc43 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:42.666925 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac48e4c-475b-4466-9630-144e0748fc43 None admin] RBAC: Adding query filter params (name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:42.667354 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac48e4c-475b-4466-9630-144e0748fc43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:42.668743 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac48e4c-475b-4466-9630-144e0748fc43 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:42.670268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2505f-929d-4d75-9ab5-fdbcf2f28653 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:42.670758 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2505f-929d-4d75-9ab5-fdbcf2f28653 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:42.671234 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2505f-929d-4d75-9ab5-fdbcf2f28653 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:42.673001 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 235/483] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:42.678327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 249/484] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:10:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:42.680307 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099500f-2ab3-41af-9dba-6ab409b86677 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:42.680587 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099500f-2ab3-41af-9dba-6ab409b86677 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:42.680918 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099500f-2ab3-41af-9dba-6ab409b86677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:42.684045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac48e4c-475b-4466-9630-144e0748fc43 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:42.704477 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-5099500f-2ab3-41af-9dba-6ab409b86677 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:42.706032 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-5099500f-2ab3-41af-9dba-6ab409b86677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:42.709874 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:42.787962 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 236/485] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:42.788724 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099500f-2ab3-41af-9dba-6ab409b86677 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:42.796528 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac48e4c-475b-4466-9630-144e0748fc43 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:42.800858 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:42.846392 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff513d-4d0d-4cfd-b83b-c72295109815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:42.847448 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff513d-4d0d-4cfd-b83b-c72295109815 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:42.848199 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff513d-4d0d-4cfd-b83b-c72295109815 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:42.849081 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff513d-4d0d-4cfd-b83b-c72295109815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:42.864184 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff513d-4d0d-4cfd-b83b-c72295109815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:42.867456 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff513d-4d0d-4cfd-b83b-c72295109815 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-e7ff513d-4d0d-4cfd-b83b-c72295109815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:42.889173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:42.890152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:42.894921 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:42.894921 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:42.894921 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:42.894921 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 250/486] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:10:42.896990 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff513d-4d0d-4cfd-b83b-c72295109815 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:42.903352 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099500f-2ab3-41af-9dba-6ab409b86677 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:42.944576 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad1b5b-ea25-4bb2-a48e-fe70d4b0f201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:42.946237 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad1b5b-ea25-4bb2-a48e-fe70d4b0f201 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:42.946724 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad1b5b-ea25-4bb2-a48e-fe70d4b0f201 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:42.947158 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad1b5b-ea25-4bb2-a48e-fe70d4b0f201 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:42.958782 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:42.963181 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad1b5b-ea25-4bb2-a48e-fe70d4b0f201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-9cad1b5b-ea25-4bb2-a48e-fe70d4b0f201 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:42.969046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:42.969978 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:42.970805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 237/487] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:42.971455 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad1b5b-ea25-4bb2-a48e-fe70d4b0f201 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:43.014636 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff513d-4d0d-4cfd-b83b-c72295109815 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:43.050903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e33c42-9645-4af3-be13-9f153e436c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:43.051501 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e33c42-9645-4af3-be13-9f153e436c9f None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:43.051777 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e33c42-9645-4af3-be13-9f153e436c9f None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:43.052043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e33c42-9645-4af3-be13-9f153e436c9f None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:43.052672 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e33c42-9645-4af3-be13-9f153e436c9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:43.052966 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e33c42-9645-4af3-be13-9f153e436c9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:43.054404 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e33c42-9645-4af3-be13-9f153e436c9f None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:43.071518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 251/488] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:43.071518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e33c42-9645-4af3-be13-9f153e436c9f None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:43.085251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad1b5b-ea25-4bb2-a48e-fe70d4b0f201 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:43.088276 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:43.121335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed974-d1e1-480e-b0cd-40114112b9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:43.121879 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed974-d1e1-480e-b0cd-40114112b9d2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:43.122184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed974-d1e1-480e-b0cd-40114112b9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:43.122450 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed974-d1e1-480e-b0cd-40114112b9d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:43.133183 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ed974-d1e1-480e-b0cd-40114112b9d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-b91ed974-d1e1-480e-b0cd-40114112b9d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:43.137974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:43.138864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:43.139729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 238/489] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:43.140412 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed974-d1e1-480e-b0cd-40114112b9d2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:43.174371 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e33c42-9645-4af3-be13-9f153e436c9f None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:43.199932 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:43.209173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc066f6-800f-47df-ba76-eebd80ca8c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:43.209818 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc066f6-800f-47df-ba76-eebd80ca8c31 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:43.210124 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc066f6-800f-47df-ba76-eebd80ca8c31 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:43.210394 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc066f6-800f-47df-ba76-eebd80ca8c31 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:43.211050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc066f6-800f-47df-ba76-eebd80ca8c31 None admin] RBAC: Adding query filter params (name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:43.211344 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc066f6-800f-47df-ba76-eebd80ca8c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:43.212732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc066f6-800f-47df-ba76-eebd80ca8c31 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:43.221762 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 252/490] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:10:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:43.222627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc066f6-800f-47df-ba76-eebd80ca8c31 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:43.240996 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed974-d1e1-480e-b0cd-40114112b9d2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:43.273988 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605ca44-54e3-48a4-88b0-b0b1e9b62810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:43.274719 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605ca44-54e3-48a4-88b0-b0b1e9b62810 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:43.274971 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605ca44-54e3-48a4-88b0-b0b1e9b62810 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:43.275231 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605ca44-54e3-48a4-88b0-b0b1e9b62810 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:43.291733 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605ca44-54e3-48a4-88b0-b0b1e9b62810 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:43.293237 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605ca44-54e3-48a4-88b0-b0b1e9b62810 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-1605ca44-54e3-48a4-88b0-b0b1e9b62810 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:10:43.306596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:43.307641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:43.308739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:43.308739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:43.308739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:10:43.308739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:10:43.308739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:10:43.308739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:10:43.308739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:10:43.308739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:10:43.308739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:10:43.308739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:43.308739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 239/491] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 23 16:10:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:43.309475 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605ca44-54e3-48a4-88b0-b0b1e9b62810 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:43.310482 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:43.333229 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc066f6-800f-47df-ba76-eebd80ca8c31 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:43.368169 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6cffb-9451-4da0-9fad-1b2f79e2d3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:43.368788 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6cffb-9451-4da0-9fad-1b2f79e2d3b9 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:43.369068 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6cffb-9451-4da0-9fad-1b2f79e2d3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:43.369339 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6cffb-9451-4da0-9fad-1b2f79e2d3b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:43.380411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6cffb-9451-4da0-9fad-1b2f79e2d3b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-0ee6cffb-9451-4da0-9fad-1b2f79e2d3b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:43.385599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:43.386704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:43.387699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 253/492] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:43.390848 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6cffb-9451-4da0-9fad-1b2f79e2d3b9 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:43.415514 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605ca44-54e3-48a4-88b0-b0b1e9b62810 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:43.438415 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:43.452859 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d334f6-b390-44d9-a7cb-3efcda181d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:43.453470 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d334f6-b390-44d9-a7cb-3efcda181d99 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:43.453746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d334f6-b390-44d9-a7cb-3efcda181d99 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:43.454020 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d334f6-b390-44d9-a7cb-3efcda181d99 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:43.454711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d334f6-b390-44d9-a7cb-3efcda181d99 None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:43.455008 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d334f6-b390-44d9-a7cb-3efcda181d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:43.456420 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d334f6-b390-44d9-a7cb-3efcda181d99 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:43.464539 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 240/493] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:10:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:43.465332 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d334f6-b390-44d9-a7cb-3efcda181d99 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:43.491938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6cffb-9451-4da0-9fad-1b2f79e2d3b9 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:43.529322 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0f6fe-6c20-4fe9-9730-b83671075edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:43.529961 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f6fe-6c20-4fe9-9730-b83671075edf None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:43.530266 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f6fe-6c20-4fe9-9730-b83671075edf None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:43.530536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f6fe-6c20-4fe9-9730-b83671075edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:43.537960 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:43.542503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0f6fe-6c20-4fe9-9730-b83671075edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:43.543971 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0f6fe-6c20-4fe9-9730-b83671075edf None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-2bb0f6fe-6c20-4fe9-9730-b83671075edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:43.558584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:43.559512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:43.560526 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:43.560526 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:43.560526 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:43.560526 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 254/494] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:43.560526 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0f6fe-6c20-4fe9-9730-b83671075edf None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:43.571915 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d334f6-b390-44d9-a7cb-3efcda181d99 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:43.605441 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161774f-a8b1-4191-886f-1690b5a69f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:43.606027 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161774f-a8b1-4191-886f-1690b5a69f21 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:43.606416 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161774f-a8b1-4191-886f-1690b5a69f21 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:43.606684 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161774f-a8b1-4191-886f-1690b5a69f21 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:43.607451 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161774f-a8b1-4191-886f-1690b5a69f21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:43.607757 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161774f-a8b1-4191-886f-1690b5a69f21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:43.609197 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161774f-a8b1-4191-886f-1690b5a69f21 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:43.646331 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 241/495] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 23 16:10:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:43.647215 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161774f-a8b1-4191-886f-1690b5a69f21 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:43.664438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0f6fe-6c20-4fe9-9730-b83671075edf None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:43.691635 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:43.699058 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cfc3a-dc33-4413-b480-bf358dec1a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:43.699678 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cfc3a-dc33-4413-b480-bf358dec1a98 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:43.699952 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cfc3a-dc33-4413-b480-bf358dec1a98 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:43.700223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cfc3a-dc33-4413-b480-bf358dec1a98 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:43.700880 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cfc3a-dc33-4413-b480-bf358dec1a98 None admin] RBAC: Adding query filter params (name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:43.701180 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cfc3a-dc33-4413-b480-bf358dec1a98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:43.702600 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cfc3a-dc33-4413-b480-bf358dec1a98 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:43.710636 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 255/496] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:10:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:43.711445 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cfc3a-dc33-4413-b480-bf358dec1a98 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:43.751961 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161774f-a8b1-4191-886f-1690b5a69f21 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:43.766243 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:43.787361 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfd0d9-8bab-4fd2-8ad5-5983ae2aadfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:43.788146 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfd0d9-8bab-4fd2-8ad5-5983ae2aadfa None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:43.788428 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfd0d9-8bab-4fd2-8ad5-5983ae2aadfa None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:43.788747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfd0d9-8bab-4fd2-8ad5-5983ae2aadfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:43.798916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfd0d9-8bab-4fd2-8ad5-5983ae2aadfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:43.800386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfd0d9-8bab-4fd2-8ad5-5983ae2aadfa None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:43.813861 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cfc3a-dc33-4413-b480-bf358dec1a98 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-9dbfd0d9-8bab-4fd2-8ad5-5983ae2aadfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:43.814707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:43.815709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:43.816534 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:43.816534 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:43.816534 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:43.816534 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 242/497] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:43.816534 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfd0d9-8bab-4fd2-8ad5-5983ae2aadfa None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:43.854301 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906682b-69d5-4343-9081-4c404fd6fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:43.854905 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906682b-69d5-4343-9081-4c404fd6fda0 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:43.855183 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906682b-69d5-4343-9081-4c404fd6fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:43.855456 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906682b-69d5-4343-9081-4c404fd6fda0 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:43.856098 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906682b-69d5-4343-9081-4c404fd6fda0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:43.856396 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906682b-69d5-4343-9081-4c404fd6fda0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:43.857788 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906682b-69d5-4343-9081-4c404fd6fda0 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:43.869477 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 256/498] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:43.870319 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906682b-69d5-4343-9081-4c404fd6fda0 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:43.912965 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:43.922221 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfd0d9-8bab-4fd2-8ad5-5983ae2aadfa None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:43.957418 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cbecd-d5b9-49e3-b99d-0cfb77567718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:43.958052 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cbecd-d5b9-49e3-b99d-0cfb77567718 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:43.958330 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cbecd-d5b9-49e3-b99d-0cfb77567718 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:43.958600 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cbecd-d5b9-49e3-b99d-0cfb77567718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:43.988964 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906682b-69d5-4343-9081-4c404fd6fda0 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:44.003375 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:44.026116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205d14b-7d79-4558-afbe-a2af6ed60014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:44.026744 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205d14b-7d79-4558-afbe-a2af6ed60014 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:44.027019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205d14b-7d79-4558-afbe-a2af6ed60014 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:44.027283 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205d14b-7d79-4558-afbe-a2af6ed60014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:44.029295 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cbecd-d5b9-49e3-b99d-0cfb77567718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:44.030791 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cbecd-d5b9-49e3-b99d-0cfb77567718 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:44.037809 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205d14b-7d79-4558-afbe-a2af6ed60014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:44.039285 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205d14b-7d79-4558-afbe-a2af6ed60014 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-b205d14b-7d79-4558-afbe-a2af6ed60014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:44.054090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:44.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:44.056056 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:44.056056 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:44.056056 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:44.056056 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 257/499] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:44.056056 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205d14b-7d79-4558-afbe-a2af6ed60014 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:44.145527 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:44.155517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 243/500] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:44.156243 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cbecd-d5b9-49e3-b99d-0cfb77567718 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:44.158109 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205d14b-7d79-4558-afbe-a2af6ed60014 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:44.192930 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19bfd9-36ff-4700-8daf-b6401b88ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:44.193537 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19bfd9-36ff-4700-8daf-b6401b88ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:44.193809 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19bfd9-36ff-4700-8daf-b6401b88ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:44.194131 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19bfd9-36ff-4700-8daf-b6401b88ddb7 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:44.195238 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19bfd9-36ff-4700-8daf-b6401b88ddb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:44.195534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19bfd9-36ff-4700-8daf-b6401b88ddb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:44.196909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19bfd9-36ff-4700-8daf-b6401b88ddb7 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:44.208632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 258/501] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:44.209428 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19bfd9-36ff-4700-8daf-b6401b88ddb7 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:44.235895 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:44.259153 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cbecd-d5b9-49e3-b99d-0cfb77567718 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:44.293631 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afec43-0836-4300-a391-6567e088d569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:44.294274 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afec43-0836-4300-a391-6567e088d569 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:44.294558 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afec43-0836-4300-a391-6567e088d569 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:44.294830 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afec43-0836-4300-a391-6567e088d569 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:44.302160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afec43-0836-4300-a391-6567e088d569 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:44.303701 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afec43-0836-4300-a391-6567e088d569 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:44.313100 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19bfd9-36ff-4700-8daf-b6401b88ddb7 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-c8afec43-0836-4300-a391-6567e088d569 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:10:44.315437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:44.316502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:44.317668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:44.317668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:44.317668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:10:44.317668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:10:44.317668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:10:44.317668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:10:44.317668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:10:44.317668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:10:44.317668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:10:44.317668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:44.317668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 244/502] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:44.317668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afec43-0836-4300-a391-6567e088d569 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:44.350707 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f81375-3b26-405a-a9a1-f74fa25caea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:44.351315 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f81375-3b26-405a-a9a1-f74fa25caea8 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:44.351584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f81375-3b26-405a-a9a1-f74fa25caea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:44.351849 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f81375-3b26-405a-a9a1-f74fa25caea8 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:44.352487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f81375-3b26-405a-a9a1-f74fa25caea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:44.352782 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f81375-3b26-405a-a9a1-f74fa25caea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:44.354214 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f81375-3b26-405a-a9a1-f74fa25caea8 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:44.366593 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 259/503] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:44.367407 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f81375-3b26-405a-a9a1-f74fa25caea8 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:44.372587 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:44.421676 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afec43-0836-4300-a391-6567e088d569 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:44.455159 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:44.456464 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af9bf8-f8ec-4bf3-a4e9-58f17bae586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:44.456851 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af9bf8-f8ec-4bf3-a4e9-58f17bae586e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:44.457158 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af9bf8-f8ec-4bf3-a4e9-58f17bae586e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:44.457423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af9bf8-f8ec-4bf3-a4e9-58f17bae586e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:44.468784 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af9bf8-f8ec-4bf3-a4e9-58f17bae586e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:44.470304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af9bf8-f8ec-4bf3-a4e9-58f17bae586e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:44.471025 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f81375-3b26-405a-a9a1-f74fa25caea8 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-d6af9bf8-f8ec-4bf3-a4e9-58f17bae586e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:44.485257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:44.486251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:44.487366 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:44.487366 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:44.487366 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:44.487366 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 245/504] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:44.487781 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af9bf8-f8ec-4bf3-a4e9-58f17bae586e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:44.513744 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1cf8c-7eb8-41f4-86b3-907b0891269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:44.514428 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1cf8c-7eb8-41f4-86b3-907b0891269a None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:44.514696 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1cf8c-7eb8-41f4-86b3-907b0891269a None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:44.514962 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1cf8c-7eb8-41f4-86b3-907b0891269a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:44.522880 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1cf8c-7eb8-41f4-86b3-907b0891269a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:44.524315 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1cf8c-7eb8-41f4-86b3-907b0891269a None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-a1f1cf8c-7eb8-41f4-86b3-907b0891269a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:10:44.537146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:44.538457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:44.539352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:44.539352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:44.539352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:10:44.539352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:10:44.539352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:10:44.539352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:10:44.539352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:10:44.539352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:10:44.539352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:10:44.539352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:44.539352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 260/505] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:44.539352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1cf8c-7eb8-41f4-86b3-907b0891269a None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:44.594987 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af9bf8-f8ec-4bf3-a4e9-58f17bae586e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:44.597319 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:44.629236 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ae8d2-2ad4-4ecc-b9ce-7c34995a09bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:44.629854 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae8d2-2ad4-4ecc-b9ce-7c34995a09bd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:44.630167 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae8d2-2ad4-4ecc-b9ce-7c34995a09bd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:44.630441 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae8d2-2ad4-4ecc-b9ce-7c34995a09bd None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:44.631180 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ae8d2-2ad4-4ecc-b9ce-7c34995a09bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:44.631484 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ae8d2-2ad4-4ecc-b9ce-7c34995a09bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:44.632988 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ae8d2-2ad4-4ecc-b9ce-7c34995a09bd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:44.641014 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1cf8c-7eb8-41f4-86b3-907b0891269a None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:44.650627 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 246/506] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Aug 23 16:10:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:44.651447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ae8d2-2ad4-4ecc-b9ce-7c34995a09bd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:44.676176 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c22c2-f41c-4948-9410-384b51b55d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:44.676868 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c22c2-f41c-4948-9410-384b51b55d2a None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:44.677138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c22c2-f41c-4948-9410-384b51b55d2a None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:44.677392 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c22c2-f41c-4948-9410-384b51b55d2a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:44.686094 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c22c2-f41c-4948-9410-384b51b55d2a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:44.687546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c22c2-f41c-4948-9410-384b51b55d2a None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-7c3c22c2-f41c-4948-9410-384b51b55d2a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:10:44.698968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:44.699899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:44.700776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:44.700776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:44.700776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:10:44.700776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:10:44.700776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:10:44.700776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:10:44.700776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:10:44.700776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:10:44.700776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:10:44.700776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:44.700776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 261/507] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:44.700776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c22c2-f41c-4948-9410-384b51b55d2a None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:44.704239 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:44.757323 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ae8d2-2ad4-4ecc-b9ce-7c34995a09bd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:44.793416 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a441f08-5f9a-4d35-8b46-212ed96d03f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:44.794033 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a441f08-5f9a-4d35-8b46-212ed96d03f5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:44.794329 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a441f08-5f9a-4d35-8b46-212ed96d03f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:44.794586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a441f08-5f9a-4d35-8b46-212ed96d03f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:44.795231 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a441f08-5f9a-4d35-8b46-212ed96d03f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:44.795534 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a441f08-5f9a-4d35-8b46-212ed96d03f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:44.796909 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a441f08-5f9a-4d35-8b46-212ed96d03f5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:44.805019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c22c2-f41c-4948-9410-384b51b55d2a None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:44.808749 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 247/508] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:44.809557 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a441f08-5f9a-4d35-8b46-212ed96d03f5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:44.834877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:44.841595 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65045f83-9012-41c4-8509-1aa67f8e4091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:44.842255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65045f83-9012-41c4-8509-1aa67f8e4091 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:44.842529 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65045f83-9012-41c4-8509-1aa67f8e4091 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:44.842798 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65045f83-9012-41c4-8509-1aa67f8e4091 None admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:44.843521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65045f83-9012-41c4-8509-1aa67f8e4091 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:44.843823 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65045f83-9012-41c4-8509-1aa67f8e4091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:44.845259 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65045f83-9012-41c4-8509-1aa67f8e4091 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:44.882235 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 262/509] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Aug 23 16:10:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:44.883826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65045f83-9012-41c4-8509-1aa67f8e4091 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:44.914611 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a441f08-5f9a-4d35-8b46-212ed96d03f5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:44.947232 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:44.950927 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa8590-2afe-424d-86be-e0934a0713a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:44.951540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa8590-2afe-424d-86be-e0934a0713a0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:44.952144 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa8590-2afe-424d-86be-e0934a0713a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:44.952873 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa8590-2afe-424d-86be-e0934a0713a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:44.987469 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65045f83-9012-41c4-8509-1aa67f8e4091 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:45.022896 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d318d3-ea0a-4531-be70-d39a8c0f9a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:45.023090 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa8590-2afe-424d-86be-e0934a0713a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:45.023432 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d318d3-ea0a-4531-be70-d39a8c0f9a9b None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:45.023707 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d318d3-ea0a-4531-be70-d39a8c0f9a9b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:45.023975 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d318d3-ea0a-4531-be70-d39a8c0f9a9b None admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:45.024383 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa8590-2afe-424d-86be-e0934a0713a0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:45.024682 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d318d3-ea0a-4531-be70-d39a8c0f9a9b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:45.024988 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d318d3-ea0a-4531-be70-d39a8c0f9a9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:45.026462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d318d3-ea0a-4531-be70-d39a8c0f9a9b None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:45.044270 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 263/510] 10.222.0.47 () {56 vars in 1139 bytes} [Tue Aug 23 16:10:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:45.045250 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d318d3-ea0a-4531-be70-d39a8c0f9a9b None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:45.051839 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:45.134140 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 248/511] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:45.134993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa8590-2afe-424d-86be-e0934a0713a0 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:45.157483 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d318d3-ea0a-4531-be70-d39a8c0f9a9b None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:45.178373 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:45.196756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e9c5a-16af-4af2-ab9d-e5b6fc455a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:45.197397 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e9c5a-16af-4af2-ab9d-e5b6fc455a62 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:45.197665 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e9c5a-16af-4af2-ab9d-e5b6fc455a62 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:45.197931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e9c5a-16af-4af2-ab9d-e5b6fc455a62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:45.204765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e9c5a-16af-4af2-ab9d-e5b6fc455a62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:45.206321 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e9c5a-16af-4af2-ab9d-e5b6fc455a62 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-805e9c5a-16af-4af2-ab9d-e5b6fc455a62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:10:45.218116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:45.219170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:45.225008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:10:45.225008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:10:45.225008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:10:45.225008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:10:45.225008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:10:45.225008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:10:45.225008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:45.225008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:45.225008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 264/512] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:45.225008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e9c5a-16af-4af2-ab9d-e5b6fc455a62 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:45.246174 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa8590-2afe-424d-86be-e0934a0713a0 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:45.270832 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:45.284119 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31b467-f9bd-4fc9-8c60-17a4ed22b258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:45.284652 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31b467-f9bd-4fc9-8c60-17a4ed22b258 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:45.284931 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31b467-f9bd-4fc9-8c60-17a4ed22b258 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:45.285203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31b467-f9bd-4fc9-8c60-17a4ed22b258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:45.322735 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e9c5a-16af-4af2-ab9d-e5b6fc455a62 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:45.352508 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31b467-f9bd-4fc9-8c60-17a4ed22b258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:45.353982 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31b467-f9bd-4fc9-8c60-17a4ed22b258 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:45.356996 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc299ac-052b-48b0-8752-e3d56cb823f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:45.357642 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc299ac-052b-48b0-8752-e3d56cb823f4 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:45.357919 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc299ac-052b-48b0-8752-e3d56cb823f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:45.358194 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc299ac-052b-48b0-8752-e3d56cb823f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:45.414266 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:45.442549 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc299ac-052b-48b0-8752-e3d56cb823f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:45.444858 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc299ac-052b-48b0-8752-e3d56cb823f4 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:45.459857 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 249/513] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:45.459857 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31b467-f9bd-4fc9-8c60-17a4ed22b258 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:45.483613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:45.569417 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 265/514] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:45.570240 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc299ac-052b-48b0-8752-e3d56cb823f4 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:45.577019 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31b467-f9bd-4fc9-8c60-17a4ed22b258 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:45.612684 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74568b-35de-4c19-a1ae-fdc16c94f19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:45.613326 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74568b-35de-4c19-a1ae-fdc16c94f19a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:45.613604 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74568b-35de-4c19-a1ae-fdc16c94f19a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:45.613876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74568b-35de-4c19-a1ae-fdc16c94f19a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:45.624527 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74568b-35de-4c19-a1ae-fdc16c94f19a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:45.626027 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74568b-35de-4c19-a1ae-fdc16c94f19a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-3a74568b-35de-4c19-a1ae-fdc16c94f19a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:45.642257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:45.643347 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:45.644330 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:45.644330 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:45.644330 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:45.644330 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 250/515] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:45.644330 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74568b-35de-4c19-a1ae-fdc16c94f19a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:45.659272 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:45.681976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc299ac-052b-48b0-8752-e3d56cb823f4 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:45.720544 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffd286-0f2c-4733-875a-6fa762e6bb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:45.721153 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffd286-0f2c-4733-875a-6fa762e6bb76 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:45.721433 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffd286-0f2c-4733-875a-6fa762e6bb76 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:45.721700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffd286-0f2c-4733-875a-6fa762e6bb76 None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:45.722441 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffd286-0f2c-4733-875a-6fa762e6bb76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:45.722741 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffd286-0f2c-4733-875a-6fa762e6bb76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:45.724179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffd286-0f2c-4733-875a-6fa762e6bb76 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:45.728663 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:45.742884 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 266/516] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:10:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:45.743741 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffd286-0f2c-4733-875a-6fa762e6bb76 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:45.754935 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74568b-35de-4c19-a1ae-fdc16c94f19a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:45.788750 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d68a8-1ae1-4f34-9d14-da9bef56acb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:45.789371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d68a8-1ae1-4f34-9d14-da9bef56acb7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:45.789643 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d68a8-1ae1-4f34-9d14-da9bef56acb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:45.789905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d68a8-1ae1-4f34-9d14-da9bef56acb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:45.800643 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d68a8-1ae1-4f34-9d14-da9bef56acb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:45.802257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d68a8-1ae1-4f34-9d14-da9bef56acb7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-950d68a8-1ae1-4f34-9d14-da9bef56acb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:45.816588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:45.817544 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:45.818447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:45.818447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:45.818447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:45.818447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 251/517] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:45.818658 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d68a8-1ae1-4f34-9d14-da9bef56acb7 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:45.847407 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffd286-0f2c-4733-875a-6fa762e6bb76 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:45.881205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b088f6-c9d1-4248-8469-385ab0310570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:45.882047 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b088f6-c9d1-4248-8469-385ab0310570 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:45.882329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b088f6-c9d1-4248-8469-385ab0310570 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:45.882890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b088f6-c9d1-4248-8469-385ab0310570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:45.891593 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:45.893848 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b088f6-c9d1-4248-8469-385ab0310570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:45.895475 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b088f6-c9d1-4248-8469-385ab0310570 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-89b088f6-c9d1-4248-8469-385ab0310570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:45.912107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:45.913138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:45.913980 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:45.913980 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:45.913980 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:45.913980 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 267/518] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:45.914251 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b088f6-c9d1-4248-8469-385ab0310570 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:45.926379 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d68a8-1ae1-4f34-9d14-da9bef56acb7 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:45.951211 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:45.961300 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c0ec4-2445-4cb0-9a8d-9c1529b068f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:45.961983 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0ec4-2445-4cb0-9a8d-9c1529b068f8 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:45.962269 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0ec4-2445-4cb0-9a8d-9c1529b068f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:45.962616 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0ec4-2445-4cb0-9a8d-9c1529b068f8 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:45.963255 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c0ec4-2445-4cb0-9a8d-9c1529b068f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:45.963977 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c0ec4-2445-4cb0-9a8d-9c1529b068f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:45.965105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c0ec4-2445-4cb0-9a8d-9c1529b068f8 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:45.979730 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 252/519] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:45.980745 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c0ec4-2445-4cb0-9a8d-9c1529b068f8 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:46.025874 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b088f6-c9d1-4248-8469-385ab0310570 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:46.062008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088900b6-363e-4d97-abb2-b735963d414b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:46.062786 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088900b6-363e-4d97-abb2-b735963d414b None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:46.063069 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088900b6-363e-4d97-abb2-b735963d414b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:46.063338 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088900b6-363e-4d97-abb2-b735963d414b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:46.064074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088900b6-363e-4d97-abb2-b735963d414b None admin] RBAC: Adding query filter params (role.id=da50bea8a0ef44dfb668a170a3d0a49a, scope.project.id=ce23217f97fd4906afea681353330615, user.id=9c6749b0664141529ce43b78fbc836ee) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:46.064381 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088900b6-363e-4d97-abb2-b735963d414b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:46.065843 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088900b6-363e-4d97-abb2-b735963d414b None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:46.071980 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 268/520] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:45 2022] GET /identity/v3/role_assignments?user.id=9c6749b0664141529ce43b78fbc836ee&scope.project.id=ce23217f97fd4906afea681353330615&role.id=da50bea8a0ef44dfb668a170a3d0a49a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:46.086260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088900b6-363e-4d97-abb2-b735963d414b None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:46.098097 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c0ec4-2445-4cb0-9a8d-9c1529b068f8 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:46.138121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74f4b2-3538-4d8e-b5a8-ec3e90e9e941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:46.138749 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74f4b2-3538-4d8e-b5a8-ec3e90e9e941 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:46.139022 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74f4b2-3538-4d8e-b5a8-ec3e90e9e941 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:46.139288 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74f4b2-3538-4d8e-b5a8-ec3e90e9e941 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:46.139955 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74f4b2-3538-4d8e-b5a8-ec3e90e9e941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:46.140253 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74f4b2-3538-4d8e-b5a8-ec3e90e9e941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:46.141687 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74f4b2-3538-4d8e-b5a8-ec3e90e9e941 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:46.144021 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:46.159151 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 253/521] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:46.159151 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74f4b2-3538-4d8e-b5a8-ec3e90e9e941 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:46.202150 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088900b6-363e-4d97-abb2-b735963d414b None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:46.206702 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:46.243228 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b43ff-66e6-4878-9b58-3dd33ea9b3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:46.243856 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b43ff-66e6-4878-9b58-3dd33ea9b3e8 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:46.244520 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b43ff-66e6-4878-9b58-3dd33ea9b3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:46.244799 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b43ff-66e6-4878-9b58-3dd33ea9b3e8 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:46.245773 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b43ff-66e6-4878-9b58-3dd33ea9b3e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:46.246117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b43ff-66e6-4878-9b58-3dd33ea9b3e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:46.247524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b43ff-66e6-4878-9b58-3dd33ea9b3e8 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:46.260844 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 269/522] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:46.261655 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b43ff-66e6-4878-9b58-3dd33ea9b3e8 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:46.271193 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74f4b2-3538-4d8e-b5a8-ec3e90e9e941 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:46.314739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a961e5e-6f16-443f-b054-a840e8631fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:46.315365 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a961e5e-6f16-443f-b054-a840e8631fd6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:46.315638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a961e5e-6f16-443f-b054-a840e8631fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:46.315913 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a961e5e-6f16-443f-b054-a840e8631fd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:46.322916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a961e5e-6f16-443f-b054-a840e8631fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:46.324401 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a961e5e-6f16-443f-b054-a840e8631fd6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-5a961e5e-6f16-443f-b054-a840e8631fd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:10:46.336679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:46.337613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:46.338540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:10:46.338540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:10:46.338540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:10:46.338540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:10:46.338540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:10:46.338540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:10:46.338540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:46.338540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:46.338540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 254/523] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:46.339001 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a961e5e-6f16-443f-b054-a840e8631fd6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:46.379759 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b43ff-66e6-4878-9b58-3dd33ea9b3e8 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:46.399146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:46.420308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad8e44-8894-4350-9946-ceb50396bd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:46.421079 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad8e44-8894-4350-9946-ceb50396bd48 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:46.421347 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad8e44-8894-4350-9946-ceb50396bd48 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:46.421697 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad8e44-8894-4350-9946-ceb50396bd48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:46.429300 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad8e44-8894-4350-9946-ceb50396bd48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:46.430823 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad8e44-8894-4350-9946-ceb50396bd48 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-12ad8e44-8894-4350-9946-ceb50396bd48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:10:46.443196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:46.444765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:46.446357 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:10:46.446357 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:10:46.446357 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:10:46.446357 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:10:46.446357 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:10:46.446357 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:10:46.446357 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:46.446357 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:46.449094 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 270/524] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:46.449989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad8e44-8894-4350-9946-ceb50396bd48 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:46.473623 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a961e5e-6f16-443f-b054-a840e8631fd6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:46.489204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:46.532032 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040488e-cc39-4373-a0f4-b12f11c10e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:46.532802 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040488e-cc39-4373-a0f4-b12f11c10e0a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:46.533142 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040488e-cc39-4373-a0f4-b12f11c10e0a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:46.533477 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040488e-cc39-4373-a0f4-b12f11c10e0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:46.541743 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040488e-cc39-4373-a0f4-b12f11c10e0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:46.543327 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040488e-cc39-4373-a0f4-b12f11c10e0a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-e040488e-cc39-4373-a0f4-b12f11c10e0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:10:46.556124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:46.557239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:46.558302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:10:46.558302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:10:46.558302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:10:46.558302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:10:46.558302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:10:46.558302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:10:46.558302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:46.558302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:46.562516 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 255/525] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:46.563374 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040488e-cc39-4373-a0f4-b12f11c10e0a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:46.565152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad8e44-8894-4350-9946-ceb50396bd48 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:46.601709 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57b470-2516-45df-ac43-1d3ae14a5255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:46.602354 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57b470-2516-45df-ac43-1d3ae14a5255 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:46.602630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57b470-2516-45df-ac43-1d3ae14a5255 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:46.602894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57b470-2516-45df-ac43-1d3ae14a5255 None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:46.603591 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57b470-2516-45df-ac43-1d3ae14a5255 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:46.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57b470-2516-45df-ac43-1d3ae14a5255 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:46.605389 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57b470-2516-45df-ac43-1d3ae14a5255 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:46.622458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 271/526] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:46.622458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57b470-2516-45df-ac43-1d3ae14a5255 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:46.662754 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:46.680766 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040488e-cc39-4373-a0f4-b12f11c10e0a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:46.718875 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1c33-078a-4548-a212-b387de561253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:46.719633 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1c33-078a-4548-a212-b387de561253 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:46.719910 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1c33-078a-4548-a212-b387de561253 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:46.720176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1c33-078a-4548-a212-b387de561253 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:46.720871 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1c33-078a-4548-a212-b387de561253 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:46.721176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1c33-078a-4548-a212-b387de561253 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:46.722654 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1c33-078a-4548-a212-b387de561253 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:46.732541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57b470-2516-45df-ac43-1d3ae14a5255 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:46.740933 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 256/527] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:46.742140 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1c33-078a-4548-a212-b387de561253 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:46.778500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f4ae-5184-465c-aa15-edfee1b23799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:46.778500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f4ae-5184-465c-aa15-edfee1b23799 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:46.778500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f4ae-5184-465c-aa15-edfee1b23799 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:46.778500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f4ae-5184-465c-aa15-edfee1b23799 None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:46.778961 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7f4ae-5184-465c-aa15-edfee1b23799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:46.778961 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7f4ae-5184-465c-aa15-edfee1b23799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:46.778961 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7f4ae-5184-465c-aa15-edfee1b23799 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:46.790118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:46.792982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 272/528] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:46.793752 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f4ae-5184-465c-aa15-edfee1b23799 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:46.876994 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1c33-078a-4548-a212-b387de561253 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:46.895626 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:46.903232 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f4ae-5184-465c-aa15-edfee1b23799 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:46.916896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219225ec-ca68-4d33-ba7f-b9039624bba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:46.917748 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219225ec-ca68-4d33-ba7f-b9039624bba3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:46.918320 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219225ec-ca68-4d33-ba7f-b9039624bba3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:46.918757 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219225ec-ca68-4d33-ba7f-b9039624bba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:46.919757 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219225ec-ca68-4d33-ba7f-b9039624bba3 None admin] RBAC: Adding query filter params (role.id=da50bea8a0ef44dfb668a170a3d0a49a, scope.project.id=ce23217f97fd4906afea681353330615, user.id=5ff3c93c8cca444cba0362960b57a6bc) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:46.920248 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219225ec-ca68-4d33-ba7f-b9039624bba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:46.921992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219225ec-ca68-4d33-ba7f-b9039624bba3 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:46.928424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 257/529] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:46 2022] GET /identity/v3/role_assignments?user.id=5ff3c93c8cca444cba0362960b57a6bc&scope.project.id=ce23217f97fd4906afea681353330615&role.id=da50bea8a0ef44dfb668a170a3d0a49a => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:46.929847 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219225ec-ca68-4d33-ba7f-b9039624bba3 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:46.952772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b89c0-28b8-4a31-aad3-2bdb3de09164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:46.953631 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b89c0-28b8-4a31-aad3-2bdb3de09164 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:46.953978 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b89c0-28b8-4a31-aad3-2bdb3de09164 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:46.954348 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b89c0-28b8-4a31-aad3-2bdb3de09164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:46.955492 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b89c0-28b8-4a31-aad3-2bdb3de09164 None admin] RBAC: Adding query filter params (role.id=da50bea8a0ef44dfb668a170a3d0a49a, scope.project.id=ce23217f97fd4906afea681353330615, user.id=f2225825e32a488ea5bca33c00bb1b5c) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:46.955932 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b89c0-28b8-4a31-aad3-2bdb3de09164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:46.958125 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b89c0-28b8-4a31-aad3-2bdb3de09164 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:46.974025 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 273/530] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:46 2022] GET /identity/v3/role_assignments?user.id=f2225825e32a488ea5bca33c00bb1b5c&scope.project.id=ce23217f97fd4906afea681353330615&role.id=da50bea8a0ef44dfb668a170a3d0a49a => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:47.059244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:47.070782 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219225ec-ca68-4d33-ba7f-b9039624bba3 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:47.112792 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75ac30-7d04-4bda-8a68-4088181f24f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:47.113460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75ac30-7d04-4bda-8a68-4088181f24f2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:47.113744 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75ac30-7d04-4bda-8a68-4088181f24f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:47.114050 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75ac30-7d04-4bda-8a68-4088181f24f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:47.114817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75ac30-7d04-4bda-8a68-4088181f24f2 None admin] RBAC: Adding query filter params (role.id=da50bea8a0ef44dfb668a170a3d0a49a, scope.project.id=ce23217f97fd4906afea681353330615, user.id=2562343e356e47fc86503e2b9cfa0269) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:47.115122 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75ac30-7d04-4bda-8a68-4088181f24f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:47.116860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75ac30-7d04-4bda-8a68-4088181f24f2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:47.127857 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 258/531] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:46 2022] GET /identity/v3/role_assignments?user.id=2562343e356e47fc86503e2b9cfa0269&scope.project.id=ce23217f97fd4906afea681353330615&role.id=da50bea8a0ef44dfb668a170a3d0a49a => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:48.276154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e4b6c-7da0-4b67-9e33-edaa433c7b7b None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:48.276686 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e4b6c-7da0-4b67-9e33-edaa433c7b7b None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:48.276686 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e4b6c-7da0-4b67-9e33-edaa433c7b7b None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:48.278257 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 274/532] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:48.283965 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51612a3-52f4-4b82-8274-7238f5a716a7 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:48.284367 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51612a3-52f4-4b82-8274-7238f5a716a7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:48.284542 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51612a3-52f4-4b82-8274-7238f5a716a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:48.303312 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b51612a3-52f4-4b82-8274-7238f5a716a7 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:48.304526 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b51612a3-52f4-4b82-8274-7238f5a716a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:48.372768 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 259/533] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:48.701691 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e4b6c-7da0-4b67-9e33-edaa433c7b7b None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:48.813258 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e4b6c-7da0-4b67-9e33-edaa433c7b7b None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:48.849862 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef90b7-e0a4-4d70-b519-98e267cd2808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:48.850926 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef90b7-e0a4-4d70-b519-98e267cd2808 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:48.851398 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef90b7-e0a4-4d70-b519-98e267cd2808 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:48.851883 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef90b7-e0a4-4d70-b519-98e267cd2808 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:48.863365 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef90b7-e0a4-4d70-b519-98e267cd2808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-68ef90b7-e0a4-4d70-b519-98e267cd2808 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:48.868625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:48.869496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:48.870335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:48.870335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:48.870335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:48.870335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:48.870335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:48.870335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:48.870335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:48.870335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:48.870335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:48.870335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:48.870335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:48.870335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:48.872893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 275/534] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:48.878439 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51612a3-52f4-4b82-8274-7238f5a716a7 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:48.965458 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:48.981579 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51612a3-52f4-4b82-8274-7238f5a716a7 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:49.019169 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f77fcd-ab09-4095-ac1b-f5527d72a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:49.019807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f77fcd-ab09-4095-ac1b-f5527d72a888 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.020087 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f77fcd-ab09-4095-ac1b-f5527d72a888 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.020352 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f77fcd-ab09-4095-ac1b-f5527d72a888 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.021048 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f77fcd-ab09-4095-ac1b-f5527d72a888 None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:49.021348 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f77fcd-ab09-4095-ac1b-f5527d72a888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:49.022862 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f77fcd-ab09-4095-ac1b-f5527d72a888 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:49.033382 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 260/535] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:10:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:49.038773 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef90b7-e0a4-4d70-b519-98e267cd2808 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:49.064617 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:49.148593 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef90b7-e0a4-4d70-b519-98e267cd2808 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:49.188476 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd958fd8-2593-4ae0-a567-685a7555c577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:49.189117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd958fd8-2593-4ae0-a567-685a7555c577 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.189390 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd958fd8-2593-4ae0-a567-685a7555c577 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.189659 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd958fd8-2593-4ae0-a567-685a7555c577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.198495 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff19307-1c96-43ff-b1d4-63d80df81ebb None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.198859 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff19307-1c96-43ff-b1d4-63d80df81ebb None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.199200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff19307-1c96-43ff-b1d4-63d80df81ebb None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.200768 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 261/536] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:49.204968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd958fd8-2593-4ae0-a567-685a7555c577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:49.206916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd958fd8-2593-4ae0-a567-685a7555c577 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:49.207025 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6869cb-613d-468e-a37b-d7431407f23d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.207290 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6869cb-613d-468e-a37b-d7431407f23d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.207639 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6869cb-613d-468e-a37b-d7431407f23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-fd958fd8-2593-4ae0-a567-685a7555c577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:49.225474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:49.226500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:49.227339 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:49.227339 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:49.227339 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:49.228956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 276/537] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:10:49.229230 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-6c6869cb-613d-468e-a37b-d7431407f23d None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:49.234327 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-6c6869cb-613d-468e-a37b-d7431407f23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:49.234498 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd958fd8-2593-4ae0-a567-685a7555c577 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:49.306933 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 262/538] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:49.311618 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c860281-8af0-4439-aba2-7d577402f820 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.312147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c860281-8af0-4439-aba2-7d577402f820 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.312846 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c860281-8af0-4439-aba2-7d577402f820 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.314170 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:49.317076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 263/539] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:49.322529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753f181-746a-46f6-9394-5d53bd7eb9db None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.322810 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753f181-746a-46f6-9394-5d53bd7eb9db None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.323103 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753f181-746a-46f6-9394-5d53bd7eb9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.343515 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-9753f181-746a-46f6-9394-5d53bd7eb9db None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:49.344941 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-9753f181-746a-46f6-9394-5d53bd7eb9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:49.353869 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd958fd8-2593-4ae0-a567-685a7555c577 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:49.392516 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dffd4d-dfee-4747-aeee-32fd7491b8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:49.393556 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dffd4d-dfee-4747-aeee-32fd7491b8af None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.394051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dffd4d-dfee-4747-aeee-32fd7491b8af None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.394485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dffd4d-dfee-4747-aeee-32fd7491b8af None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.395315 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dffd4d-dfee-4747-aeee-32fd7491b8af None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:49.395867 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dffd4d-dfee-4747-aeee-32fd7491b8af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:49.397566 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dffd4d-dfee-4747-aeee-32fd7491b8af None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:49.411101 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 277/540] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:49.412828 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81479-6291-4bf6-b904-ab4cad6e453d None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.413132 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81479-6291-4bf6-b904-ab4cad6e453d None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.413451 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81479-6291-4bf6-b904-ab4cad6e453d None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.418176 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 278/541] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:49.418176 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81479-6291-4bf6-b904-ab4cad6e453d None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:49.420004 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 264/542] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:49.421135 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b7658-7536-4374-957b-d56e0296f40b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.421412 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b7658-7536-4374-957b-d56e0296f40b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.421684 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b7658-7536-4374-957b-d56e0296f40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.437187 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:49.446376 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-390b7658-7536-4374-957b-d56e0296f40b None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:49.447660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-390b7658-7536-4374-957b-d56e0296f40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:49.526397 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 265/543] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:49.534983 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81479-6291-4bf6-b904-ab4cad6e453d None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:49.568989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:49.574656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c94da-29ff-4b4a-bae6-4a13946d81cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:49.575299 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c94da-29ff-4b4a-bae6-4a13946d81cd None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.575575 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c94da-29ff-4b4a-bae6-4a13946d81cd None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.575945 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c94da-29ff-4b4a-bae6-4a13946d81cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.583768 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c94da-29ff-4b4a-bae6-4a13946d81cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:49.585275 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c94da-29ff-4b4a-bae6-4a13946d81cd None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-933c94da-29ff-4b4a-bae6-4a13946d81cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:10:49.598187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:49.599179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:49.600151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:49.600151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:49.600151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:10:49.600151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:10:49.600151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:10:49.600151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:10:49.600151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:10:49.600151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:10:49.600151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:10:49.600151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:49.600151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 279/544] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 23 16:10:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:49.605525 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b7658-7536-4374-957b-d56e0296f40b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:49.644232 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c94da-29ff-4b4a-bae6-4a13946d81cd None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:49.715367 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b7658-7536-4374-957b-d56e0296f40b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:49.754154 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1f549-a8fb-42a8-ae2a-f84316d95359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:49.754688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1f549-a8fb-42a8-ae2a-f84316d95359 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.754967 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1f549-a8fb-42a8-ae2a-f84316d95359 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.755238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1f549-a8fb-42a8-ae2a-f84316d95359 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.755971 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1f549-a8fb-42a8-ae2a-f84316d95359 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:49.756399 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1f549-a8fb-42a8-ae2a-f84316d95359 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:49.757976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1f549-a8fb-42a8-ae2a-f84316d95359 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:49.761346 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:49.778826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c94da-29ff-4b4a-bae6-4a13946d81cd None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:49.782400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 266/545] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 23 16:10:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:49.783361 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1f549-a8fb-42a8-ae2a-f84316d95359 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:49.815015 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eebe9-eed3-4160-85eb-0457a4b9a678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:49.815646 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eebe9-eed3-4160-85eb-0457a4b9a678 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.815927 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eebe9-eed3-4160-85eb-0457a4b9a678 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.816208 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eebe9-eed3-4160-85eb-0457a4b9a678 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.827099 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eebe9-eed3-4160-85eb-0457a4b9a678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-fa7eebe9-eed3-4160-85eb-0457a4b9a678 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:49.833263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:49.834458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:49.835327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:49.835327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:49.835327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:49.835327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:49.835327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:49.835327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:49.835327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:49.835327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:49.835327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:49.835327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:49.835327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:49.835327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:49.837804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 280/546] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:49.838655 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eebe9-eed3-4160-85eb-0457a4b9a678 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:49.893802 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:49.904485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1f549-a8fb-42a8-ae2a-f84316d95359 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:49.942253 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed960dd-05f6-4baa-adbd-3f66114bd436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:49.942882 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed960dd-05f6-4baa-adbd-3f66114bd436 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.943158 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed960dd-05f6-4baa-adbd-3f66114bd436 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.943424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed960dd-05f6-4baa-adbd-3f66114bd436 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.944507 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eebe9-eed3-4160-85eb-0457a4b9a678 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:49.953530 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed960dd-05f6-4baa-adbd-3f66114bd436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-5ed960dd-05f6-4baa-adbd-3f66114bd436 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:49.958256 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:49.959244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:49.960041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 267/547] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:49.960704 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed960dd-05f6-4baa-adbd-3f66114bd436 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:49.979956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbe356-84e2-4e93-b24e-677a84800005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:49.980605 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbe356-84e2-4e93-b24e-677a84800005 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:49.980874 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbe356-84e2-4e93-b24e-677a84800005 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:49.981141 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbe356-84e2-4e93-b24e-677a84800005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:49.993465 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbe356-84e2-4e93-b24e-677a84800005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:49.995000 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbe356-84e2-4e93-b24e-677a84800005 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-08fbe356-84e2-4e93-b24e-677a84800005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:50.010274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:50.011160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:50.012082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:50.012082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:50.012082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:50.012082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 281/548] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:50.012082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbe356-84e2-4e93-b24e-677a84800005 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:50.023849 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:50.068262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed960dd-05f6-4baa-adbd-3f66114bd436 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:50.103676 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f962c-eede-46ff-9590-b11213f6d1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:50.104282 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f962c-eede-46ff-9590-b11213f6d1a3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:50.104561 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f962c-eede-46ff-9590-b11213f6d1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:50.104835 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f962c-eede-46ff-9590-b11213f6d1a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:50.105502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f962c-eede-46ff-9590-b11213f6d1a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:50.105807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f962c-eede-46ff-9590-b11213f6d1a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:50.107231 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f962c-eede-46ff-9590-b11213f6d1a3 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:50.111990 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbe356-84e2-4e93-b24e-677a84800005 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:50.114373 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:50.115358 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 268/549] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:10:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:50.116159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f962c-eede-46ff-9590-b11213f6d1a3 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:50.146443 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456de5-6c12-4b7d-a7f9-06765da4a0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:50.147148 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456de5-6c12-4b7d-a7f9-06765da4a0ce None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:50.147428 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456de5-6c12-4b7d-a7f9-06765da4a0ce None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:50.147750 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456de5-6c12-4b7d-a7f9-06765da4a0ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:50.158936 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db456de5-6c12-4b7d-a7f9-06765da4a0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-db456de5-6c12-4b7d-a7f9-06765da4a0ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:50.164984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:50.165903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:50.166887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 282/550] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:50.167938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456de5-6c12-4b7d-a7f9-06765da4a0ce None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:50.223881 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f962c-eede-46ff-9590-b11213f6d1a3 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:50.244621 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:50.273982 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab2c8d-3fdd-4714-bc8a-42ab5a62c03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:50.274558 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab2c8d-3fdd-4714-bc8a-42ab5a62c03d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:50.274847 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab2c8d-3fdd-4714-bc8a-42ab5a62c03d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:50.275170 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab2c8d-3fdd-4714-bc8a-42ab5a62c03d None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:50.275862 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab2c8d-3fdd-4714-bc8a-42ab5a62c03d None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:50.276186 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab2c8d-3fdd-4714-bc8a-42ab5a62c03d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:50.277553 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab2c8d-3fdd-4714-bc8a-42ab5a62c03d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:50.286911 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 269/551] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:10:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:50.291631 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab2c8d-3fdd-4714-bc8a-42ab5a62c03d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:50.299720 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456de5-6c12-4b7d-a7f9-06765da4a0ce None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:50.338865 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4de45-382d-4375-bc21-893cbe5277f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:50.339562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4de45-382d-4375-bc21-893cbe5277f2 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:50.339724 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4de45-382d-4375-bc21-893cbe5277f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:50.340221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4de45-382d-4375-bc21-893cbe5277f2 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:50.340630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4de45-382d-4375-bc21-893cbe5277f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:50.340936 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4de45-382d-4375-bc21-893cbe5277f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:50.342347 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4de45-382d-4375-bc21-893cbe5277f2 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:50.356142 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 283/552] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:50.357038 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4de45-382d-4375-bc21-893cbe5277f2 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:50.385101 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:50.406617 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab2c8d-3fdd-4714-bc8a-42ab5a62c03d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:50.444998 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3e6f-215c-40cd-9f3b-a33c1e8c64b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:50.445975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3e6f-215c-40cd-9f3b-a33c1e8c64b8 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:50.446466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3e6f-215c-40cd-9f3b-a33c1e8c64b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:50.446829 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3e6f-215c-40cd-9f3b-a33c1e8c64b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:50.459564 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa3e6f-215c-40cd-9f3b-a33c1e8c64b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:50.461161 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa3e6f-215c-40cd-9f3b-a33c1e8c64b8 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:50.469528 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4de45-382d-4375-bc21-893cbe5277f2 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-ebaa3e6f-215c-40cd-9f3b-a33c1e8c64b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:50.475286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:50.476293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:50.477199 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:50.477199 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:50.477199 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:50.477199 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 270/553] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:50.478217 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3e6f-215c-40cd-9f3b-a33c1e8c64b8 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:50.509481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071390a-4a75-463b-b52c-be45a4ead3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:50.510129 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071390a-4a75-463b-b52c-be45a4ead3f0 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:50.510398 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071390a-4a75-463b-b52c-be45a4ead3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:50.510658 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071390a-4a75-463b-b52c-be45a4ead3f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:50.511309 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071390a-4a75-463b-b52c-be45a4ead3f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:50.511850 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071390a-4a75-463b-b52c-be45a4ead3f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:50.513009 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071390a-4a75-463b-b52c-be45a4ead3f0 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:50.514024 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:50.525091 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 284/554] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:10:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:50.525091 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071390a-4a75-463b-b52c-be45a4ead3f0 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:50.591477 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3e6f-215c-40cd-9f3b-a33c1e8c64b8 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:50.615510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:50.630465 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca99fab-6816-478e-85e8-6adb0cb8093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:50.631089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca99fab-6816-478e-85e8-6adb0cb8093f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:50.631366 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca99fab-6816-478e-85e8-6adb0cb8093f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:50.631634 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca99fab-6816-478e-85e8-6adb0cb8093f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:50.631798 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071390a-4a75-463b-b52c-be45a4ead3f0 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:50.642781 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca99fab-6816-478e-85e8-6adb0cb8093f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:50.644242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca99fab-6816-478e-85e8-6adb0cb8093f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-4ca99fab-6816-478e-85e8-6adb0cb8093f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:50.659089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:50.659992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:50.660883 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:50.660883 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:50.660883 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:50.660883 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 271/555] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:50.661102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca99fab-6816-478e-85e8-6adb0cb8093f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:50.669485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27b487-19ae-445f-88af-bc631743788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:50.670176 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27b487-19ae-445f-88af-bc631743788c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:50.670458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27b487-19ae-445f-88af-bc631743788c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:50.670732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27b487-19ae-445f-88af-bc631743788c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:50.677649 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27b487-19ae-445f-88af-bc631743788c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:50.679297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27b487-19ae-445f-88af-bc631743788c None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-ca27b487-19ae-445f-88af-bc631743788c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:10:50.690633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:50.691551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:50.692486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:10:50.692486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:10:50.692486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:10:50.692486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:10:50.692486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:10:50.692486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:10:50.692486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:50.692486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:50.692486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 285/556] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:50.692955 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27b487-19ae-445f-88af-bc631743788c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:50.749220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:50.768141 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca99fab-6816-478e-85e8-6adb0cb8093f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:50.800931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27b487-19ae-445f-88af-bc631743788c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:50.803175 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7456cc-aeb5-4b7c-9423-e42b842a32bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:50.803793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7456cc-aeb5-4b7c-9423-e42b842a32bd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:50.804143 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7456cc-aeb5-4b7c-9423-e42b842a32bd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:50.804422 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7456cc-aeb5-4b7c-9423-e42b842a32bd None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:50.805069 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7456cc-aeb5-4b7c-9423-e42b842a32bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:50.805375 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7456cc-aeb5-4b7c-9423-e42b842a32bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:50.806786 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7456cc-aeb5-4b7c-9423-e42b842a32bd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:50.818593 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 272/557] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:50.819408 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7456cc-aeb5-4b7c-9423-e42b842a32bd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:50.837614 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfaa10-399c-48ea-b2ac-a53d5b02a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:50.838345 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfaa10-399c-48ea-b2ac-a53d5b02a6dd None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:50.838620 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfaa10-399c-48ea-b2ac-a53d5b02a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:50.838887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfaa10-399c-48ea-b2ac-a53d5b02a6dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:50.850027 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfaa10-399c-48ea-b2ac-a53d5b02a6dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:50.851518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfaa10-399c-48ea-b2ac-a53d5b02a6dd None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:50.858076 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-3fdfaa10-399c-48ea-b2ac-a53d5b02a6dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:50.866826 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:50.867793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:50.869197 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:50.869197 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:50.869197 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:50.869197 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 286/558] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:50.869197 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfaa10-399c-48ea-b2ac-a53d5b02a6dd None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:50.934848 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7456cc-aeb5-4b7c-9423-e42b842a32bd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:50.976956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471542ac-2991-4a28-b4db-fb418d62094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:50.977663 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471542ac-2991-4a28-b4db-fb418d62094f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:50.977946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471542ac-2991-4a28-b4db-fb418d62094f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:50.978342 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471542ac-2991-4a28-b4db-fb418d62094f None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:50.978992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471542ac-2991-4a28-b4db-fb418d62094f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:50.979297 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471542ac-2991-4a28-b4db-fb418d62094f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:50.980760 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471542ac-2991-4a28-b4db-fb418d62094f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:50.992843 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 273/559] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:50.994076 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfaa10-399c-48ea-b2ac-a53d5b02a6dd None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:50.998519 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471542ac-2991-4a28-b4db-fb418d62094f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:51.002618 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:51.033187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647bea8-286f-410b-896e-9d58c839b164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:51.033879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647bea8-286f-410b-896e-9d58c839b164 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:51.034188 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647bea8-286f-410b-896e-9d58c839b164 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:51.034461 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647bea8-286f-410b-896e-9d58c839b164 None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:51.035198 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647bea8-286f-410b-896e-9d58c839b164 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:51.035499 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647bea8-286f-410b-896e-9d58c839b164 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:51.036982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647bea8-286f-410b-896e-9d58c839b164 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:51.056134 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 287/560] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:51.057398 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647bea8-286f-410b-896e-9d58c839b164 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:51.115282 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471542ac-2991-4a28-b4db-fb418d62094f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:51.120437 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:51.149649 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd429d38-c502-4a7b-a8e9-5735c787eba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:51.150285 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd429d38-c502-4a7b-a8e9-5735c787eba1 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:51.150558 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd429d38-c502-4a7b-a8e9-5735c787eba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:51.150823 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd429d38-c502-4a7b-a8e9-5735c787eba1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:51.158868 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd429d38-c502-4a7b-a8e9-5735c787eba1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:51.160309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd429d38-c502-4a7b-a8e9-5735c787eba1 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:51.163964 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647bea8-286f-410b-896e-9d58c839b164 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-bd429d38-c502-4a7b-a8e9-5735c787eba1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:10:51.171427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:51.172386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:51.173316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:51.173316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:51.173316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:10:51.173316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:10:51.173316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:10:51.173316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:10:51.173316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:10:51.173316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:10:51.173316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:10:51.173316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:51.173316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 274/561] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:51.173316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd429d38-c502-4a7b-a8e9-5735c787eba1 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:51.204240 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159359b-41d0-4350-8816-70eea1ca24e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:51.204858 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159359b-41d0-4350-8816-70eea1ca24e2 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:51.205131 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159359b-41d0-4350-8816-70eea1ca24e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:51.205399 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159359b-41d0-4350-8816-70eea1ca24e2 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:51.206055 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159359b-41d0-4350-8816-70eea1ca24e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:51.206374 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159359b-41d0-4350-8816-70eea1ca24e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:51.207749 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159359b-41d0-4350-8816-70eea1ca24e2 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:51.220671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 288/562] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:51.221594 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159359b-41d0-4350-8816-70eea1ca24e2 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:51.244352 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:51.289757 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd429d38-c502-4a7b-a8e9-5735c787eba1 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:51.327015 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e11dad-60bb-4724-8172-848dd81e4e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:51.327560 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11dad-60bb-4724-8172-848dd81e4e11 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:51.327837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11dad-60bb-4724-8172-848dd81e4e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:51.328110 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11dad-60bb-4724-8172-848dd81e4e11 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:51.332035 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159359b-41d0-4350-8816-70eea1ca24e2 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:51.335746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e11dad-60bb-4724-8172-848dd81e4e11 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:51.337208 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e11dad-60bb-4724-8172-848dd81e4e11 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-81e11dad-60bb-4724-8172-848dd81e4e11 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:10:51.348916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:51.350159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:51.351156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:51.351156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:51.351156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:10:51.351156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:10:51.351156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:10:51.351156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:10:51.351156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:10:51.351156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:10:51.351156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:10:51.351156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:51.351705 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:51.352117 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 275/563] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:51.352117 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e11dad-60bb-4724-8172-848dd81e4e11 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:51.373277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef984657-fe8f-492d-8f41-357ac92653da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:51.373957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef984657-fe8f-492d-8f41-357ac92653da None admin] REQUEST_METHOD: `PUT` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:51.374317 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef984657-fe8f-492d-8f41-357ac92653da None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:51.374593 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef984657-fe8f-492d-8f41-357ac92653da None admin] PATH_INFO: `/v3/projects/ce23217f97fd4906afea681353330615/users/9c6749b0664141529ce43b78fbc836ee/roles/da50bea8a0ef44dfb668a170a3d0a49a` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:51.390475 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef984657-fe8f-492d-8f41-357ac92653da None admin] RBAC: Authorizing `identity:create_grant(project_id=ce23217f97fd4906afea681353330615, user_id=9c6749b0664141529ce43b78fbc836ee, role_id=da50bea8a0ef44dfb668a170a3d0a49a)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:51.391925 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef984657-fe8f-492d-8f41-357ac92653da None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:51.406205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 289/564] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:10:51 2022] PUT /identity/v3/projects/ce23217f97fd4906afea681353330615/users/9c6749b0664141529ce43b78fbc836ee/roles/da50bea8a0ef44dfb668a170a3d0a49a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:51.407043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef984657-fe8f-492d-8f41-357ac92653da None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:51.463044 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e11dad-60bb-4724-8172-848dd81e4e11 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:51.488471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:51.509484 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebd170-1bf0-4144-bbcd-335d52ab7871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:51.510763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebd170-1bf0-4144-bbcd-335d52ab7871 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:51.511223 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebd170-1bf0-4144-bbcd-335d52ab7871 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:51.511924 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebd170-1bf0-4144-bbcd-335d52ab7871 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:51.513372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebd170-1bf0-4144-bbcd-335d52ab7871 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:51.514221 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebd170-1bf0-4144-bbcd-335d52ab7871 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:51.516535 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebd170-1bf0-4144-bbcd-335d52ab7871 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:51.533088 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef984657-fe8f-492d-8f41-357ac92653da None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:51.545060 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 276/565] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Aug 23 16:10:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:51.546181 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebd170-1bf0-4144-bbcd-335d52ab7871 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:51.577179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4228983-5e15-4a05-b3ca-a791d0fa3d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:51.577740 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4228983-5e15-4a05-b3ca-a791d0fa3d44 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:51.578021 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4228983-5e15-4a05-b3ca-a791d0fa3d44 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:51.578340 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4228983-5e15-4a05-b3ca-a791d0fa3d44 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:51.588241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4228983-5e15-4a05-b3ca-a791d0fa3d44 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:51.589747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4228983-5e15-4a05-b3ca-a791d0fa3d44 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-f4228983-5e15-4a05-b3ca-a791d0fa3d44 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:10:51.605674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:51.606801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:51.607934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:51.607934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:51.607934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:10:51.607934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:10:51.607934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:10:51.607934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:10:51.607934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:10:51.607934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:10:51.607934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:10:51.607934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:51.607934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 290/566] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:51.608646 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4228983-5e15-4a05-b3ca-a791d0fa3d44 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:51.641251 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:51.668625 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebd170-1bf0-4144-bbcd-335d52ab7871 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:51.703976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476542f7-ff95-4912-836f-ef1dcf7c248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:51.704597 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476542f7-ff95-4912-836f-ef1dcf7c248d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:51.704872 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476542f7-ff95-4912-836f-ef1dcf7c248d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:51.705140 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476542f7-ff95-4912-836f-ef1dcf7c248d None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:51.705875 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476542f7-ff95-4912-836f-ef1dcf7c248d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:51.706212 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476542f7-ff95-4912-836f-ef1dcf7c248d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:51.707675 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476542f7-ff95-4912-836f-ef1dcf7c248d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:51.724995 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4228983-5e15-4a05-b3ca-a791d0fa3d44 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:51.725219 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 277/567] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Aug 23 16:10:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:51.726042 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476542f7-ff95-4912-836f-ef1dcf7c248d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:51.766881 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed995ff-b9c4-4558-947f-945b1d35aa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:51.767698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:51.768726 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed995ff-b9c4-4558-947f-945b1d35aa70 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:51.769151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed995ff-b9c4-4558-947f-945b1d35aa70 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:51.769594 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed995ff-b9c4-4558-947f-945b1d35aa70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:51.783050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed995ff-b9c4-4558-947f-945b1d35aa70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:51.784807 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed995ff-b9c4-4558-947f-945b1d35aa70 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-1ed995ff-b9c4-4558-947f-945b1d35aa70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:51.799561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:51.800739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:51.801810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:51.801810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:51.801810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:51.803230 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 291/568] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:51.804093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed995ff-b9c4-4558-947f-945b1d35aa70 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:51.837822 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476542f7-ff95-4912-836f-ef1dcf7c248d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:51.874535 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b16067-e6ed-4ab8-bd33-32c34e7b63ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:51.875146 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b16067-e6ed-4ab8-bd33-32c34e7b63ef None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:51.875426 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b16067-e6ed-4ab8-bd33-32c34e7b63ef None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:51.875697 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b16067-e6ed-4ab8-bd33-32c34e7b63ef None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:51.876436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b16067-e6ed-4ab8-bd33-32c34e7b63ef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:51.876739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b16067-e6ed-4ab8-bd33-32c34e7b63ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:51.878204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b16067-e6ed-4ab8-bd33-32c34e7b63ef None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:51.895284 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:51.900499 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 278/569] 10.222.0.47 () {56 vars in 1139 bytes} [Tue Aug 23 16:10:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:51.900499 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b16067-e6ed-4ab8-bd33-32c34e7b63ef None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:51.923620 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed995ff-b9c4-4558-947f-945b1d35aa70 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:51.960368 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba17ad-32ad-499e-ab6f-ccabb9770645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:51.961018 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba17ad-32ad-499e-ab6f-ccabb9770645 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:51.961297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba17ad-32ad-499e-ab6f-ccabb9770645 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:51.961566 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba17ad-32ad-499e-ab6f-ccabb9770645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:51.974631 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba17ad-32ad-499e-ab6f-ccabb9770645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:51.976153 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba17ad-32ad-499e-ab6f-ccabb9770645 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-60ba17ad-32ad-499e-ab6f-ccabb9770645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:51.991215 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:51.992225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:51.993143 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:51.993143 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:51.993143 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:51.993143 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 292/570] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:51.998122 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba17ad-32ad-499e-ab6f-ccabb9770645 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:52.003176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:52.015367 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b16067-e6ed-4ab8-bd33-32c34e7b63ef None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:52.052476 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cf65a-4f07-48af-a585-bf3ea0c82452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:52.053272 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cf65a-4f07-48af-a585-bf3ea0c82452 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:52.053597 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cf65a-4f07-48af-a585-bf3ea0c82452 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:52.053908 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cf65a-4f07-48af-a585-bf3ea0c82452 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:52.054684 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cf65a-4f07-48af-a585-bf3ea0c82452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:52.054992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cf65a-4f07-48af-a585-bf3ea0c82452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:52.056401 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cf65a-4f07-48af-a585-bf3ea0c82452 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:52.068667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 279/571] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:52.069637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cf65a-4f07-48af-a585-bf3ea0c82452 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:52.115610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba17ad-32ad-499e-ab6f-ccabb9770645 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:52.148709 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:52.155076 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298205-ecde-4e0d-9cbb-4734bf209f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:52.155819 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298205-ecde-4e0d-9cbb-4734bf209f2c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:52.156102 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298205-ecde-4e0d-9cbb-4734bf209f2c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:52.156374 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298205-ecde-4e0d-9cbb-4734bf209f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:52.169028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74298205-ecde-4e0d-9cbb-4734bf209f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:52.170626 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74298205-ecde-4e0d-9cbb-4734bf209f2c None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:52.178266 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cf65a-4f07-48af-a585-bf3ea0c82452 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-74298205-ecde-4e0d-9cbb-4734bf209f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:52.187388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:52.188541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:52.189430 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:52.189430 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:52.189430 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:52.189430 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 293/572] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:52.189430 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298205-ecde-4e0d-9cbb-4734bf209f2c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:52.220491 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bf1b1-21cb-44f9-9ee7-bae7cb5bfd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:52.221107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bf1b1-21cb-44f9-9ee7-bae7cb5bfd79 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:52.221388 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bf1b1-21cb-44f9-9ee7-bae7cb5bfd79 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:52.221660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bf1b1-21cb-44f9-9ee7-bae7cb5bfd79 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:52.222335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bf1b1-21cb-44f9-9ee7-bae7cb5bfd79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:52.222637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bf1b1-21cb-44f9-9ee7-bae7cb5bfd79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:52.224008 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bf1b1-21cb-44f9-9ee7-bae7cb5bfd79 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:52.241302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 280/573] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:52.241302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bf1b1-21cb-44f9-9ee7-bae7cb5bfd79 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:52.257380 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:52.309117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298205-ecde-4e0d-9cbb-4734bf209f2c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:52.349705 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48104172-00f8-4850-9370-203c66fbb921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:52.350377 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48104172-00f8-4850-9370-203c66fbb921 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:52.350651 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48104172-00f8-4850-9370-203c66fbb921 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:52.350949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48104172-00f8-4850-9370-203c66fbb921 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:52.351903 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bf1b1-21cb-44f9-9ee7-bae7cb5bfd79 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:52.358028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48104172-00f8-4850-9370-203c66fbb921 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:52.359790 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48104172-00f8-4850-9370-203c66fbb921 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-48104172-00f8-4850-9370-203c66fbb921 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:10:52.372164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:52.373127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:52.374053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:10:52.374053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:10:52.374053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:10:52.374053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:10:52.374053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:10:52.374053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:10:52.374053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:52.374053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:52.374053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 294/574] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:52.374053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48104172-00f8-4850-9370-203c66fbb921 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:52.396777 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39797746-f4d2-420d-b5a0-a5f91c790c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:52.397378 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39797746-f4d2-420d-b5a0-a5f91c790c00 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:52.397668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39797746-f4d2-420d-b5a0-a5f91c790c00 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:52.397963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39797746-f4d2-420d-b5a0-a5f91c790c00 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:52.398638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39797746-f4d2-420d-b5a0-a5f91c790c00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:52.398933 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39797746-f4d2-420d-b5a0-a5f91c790c00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:52.400331 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39797746-f4d2-420d-b5a0-a5f91c790c00 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:52.416903 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 281/575] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:52.416903 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39797746-f4d2-420d-b5a0-a5f91c790c00 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:52.433160 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:52.491268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48104172-00f8-4850-9370-203c66fbb921 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:52.505715 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:52.531379 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39797746-f4d2-420d-b5a0-a5f91c790c00 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:52.533602 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae58f18-524c-4b10-ada1-48c0b5732a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:52.534297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae58f18-524c-4b10-ada1-48c0b5732a32 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:52.534570 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae58f18-524c-4b10-ada1-48c0b5732a32 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:52.534837 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae58f18-524c-4b10-ada1-48c0b5732a32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:52.542980 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae58f18-524c-4b10-ada1-48c0b5732a32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:52.544466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae58f18-524c-4b10-ada1-48c0b5732a32 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-0ae58f18-524c-4b10-ada1-48c0b5732a32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:10:52.557051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:52.558070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:52.558984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:10:52.558984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:10:52.558984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:10:52.558984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:10:52.558984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:10:52.558984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:10:52.558984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:52.558984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:52.558984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 295/576] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:52.558984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae58f18-524c-4b10-ada1-48c0b5732a32 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:52.577771 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b92302-8cf3-455f-884f-2f6decce6825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:52.578663 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b92302-8cf3-455f-884f-2f6decce6825 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:52.579101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b92302-8cf3-455f-884f-2f6decce6825 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:52.579541 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b92302-8cf3-455f-884f-2f6decce6825 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:52.580435 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b92302-8cf3-455f-884f-2f6decce6825 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:52.580884 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b92302-8cf3-455f-884f-2f6decce6825 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:52.582517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b92302-8cf3-455f-884f-2f6decce6825 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:52.595642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 282/577] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:10:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:52.596668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b92302-8cf3-455f-884f-2f6decce6825 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:52.687010 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae58f18-524c-4b10-ada1-48c0b5732a32 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:52.689907 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:52.712628 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b92302-8cf3-455f-884f-2f6decce6825 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:52.726446 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e1f73-d543-4e26-8302-a0ffb40fec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:52.727192 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e1f73-d543-4e26-8302-a0ffb40fec0f None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:52.727468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e1f73-d543-4e26-8302-a0ffb40fec0f None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:52.727737 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e1f73-d543-4e26-8302-a0ffb40fec0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:52.735283 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e1f73-d543-4e26-8302-a0ffb40fec0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:52.736862 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e1f73-d543-4e26-8302-a0ffb40fec0f None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:52.749115 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3ffbd-06fb-41c9-9765-88c46d9fea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-e55e1f73-d543-4e26-8302-a0ffb40fec0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:10:52.749320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:52.750178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:52.751093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:10:52.751093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:10:52.751093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:10:52.751093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:10:52.751093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:10:52.751093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:10:52.751093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:52.751093 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:52.751521 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3ffbd-06fb-41c9-9765-88c46d9fea3b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:52.751521 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3ffbd-06fb-41c9-9765-88c46d9fea3b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:52.751521 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3ffbd-06fb-41c9-9765-88c46d9fea3b None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:52.751697 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 296/578] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:52.751777 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3ffbd-06fb-41c9-9765-88c46d9fea3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:52.751936 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e1f73-d543-4e26-8302-a0ffb40fec0f None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:52.752008 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3ffbd-06fb-41c9-9765-88c46d9fea3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:52.752910 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3ffbd-06fb-41c9-9765-88c46d9fea3b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:52.760302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:52.770764 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 283/579] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:10:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:52.770764 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3ffbd-06fb-41c9-9765-88c46d9fea3b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:52.877168 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e1f73-d543-4e26-8302-a0ffb40fec0f None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:52.878812 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3ffbd-06fb-41c9-9765-88c46d9fea3b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:52.915145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213d114-2471-44fa-a784-14a0362fda3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:52.915872 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213d114-2471-44fa-a784-14a0362fda3b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:52.916207 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213d114-2471-44fa-a784-14a0362fda3b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:52.916535 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213d114-2471-44fa-a784-14a0362fda3b None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:52.917287 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213d114-2471-44fa-a784-14a0362fda3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:52.917644 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213d114-2471-44fa-a784-14a0362fda3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:52.919173 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213d114-2471-44fa-a784-14a0362fda3b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:52.930906 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3113be4-ac48-4dd8-9364-dba14db59e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:52.936499 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 284/580] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:10:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:52.936633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113be4-ac48-4dd8-9364-dba14db59e24 None admin] REQUEST_METHOD: `PUT` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:52.936724 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213d114-2471-44fa-a784-14a0362fda3b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:52.936807 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113be4-ac48-4dd8-9364-dba14db59e24 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:52.936807 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113be4-ac48-4dd8-9364-dba14db59e24 None admin] PATH_INFO: `/v3/projects/ce23217f97fd4906afea681353330615/users/5ff3c93c8cca444cba0362960b57a6bc/roles/da50bea8a0ef44dfb668a170a3d0a49a` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:52.953123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3113be4-ac48-4dd8-9364-dba14db59e24 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce23217f97fd4906afea681353330615, user_id=5ff3c93c8cca444cba0362960b57a6bc, role_id=da50bea8a0ef44dfb668a170a3d0a49a)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:52.954890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3113be4-ac48-4dd8-9364-dba14db59e24 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:52.970207 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 297/581] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:10:52 2022] PUT /identity/v3/projects/ce23217f97fd4906afea681353330615/users/5ff3c93c8cca444cba0362960b57a6bc/roles/da50bea8a0ef44dfb668a170a3d0a49a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:52.971035 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3113be4-ac48-4dd8-9364-dba14db59e24 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:52.999491 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:53.047989 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:53.103461 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213d114-2471-44fa-a784-14a0362fda3b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:53.145126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049dba5-20f9-4b19-9ede-31703ac168d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:53.146253 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049dba5-20f9-4b19-9ede-31703ac168d7 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:53.146645 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049dba5-20f9-4b19-9ede-31703ac168d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:53.147029 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049dba5-20f9-4b19-9ede-31703ac168d7 None admin] PATH_INFO: `/v3/projects/ce23217f97fd4906afea681353330615/users/f2225825e32a488ea5bca33c00bb1b5c/roles/da50bea8a0ef44dfb668a170a3d0a49a` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:53.148824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3113be4-ac48-4dd8-9364-dba14db59e24 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:53.171716 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049dba5-20f9-4b19-9ede-31703ac168d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce23217f97fd4906afea681353330615, user_id=f2225825e32a488ea5bca33c00bb1b5c, role_id=da50bea8a0ef44dfb668a170a3d0a49a)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:53.173432 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049dba5-20f9-4b19-9ede-31703ac168d7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:53.192952 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 285/582] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:10:52 2022] PUT /identity/v3/projects/ce23217f97fd4906afea681353330615/users/f2225825e32a488ea5bca33c00bb1b5c/roles/da50bea8a0ef44dfb668a170a3d0a49a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:53.201156 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703b84d-f273-4bb6-9c5f-86ab5191e7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:53.201855 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703b84d-f273-4bb6-9c5f-86ab5191e7c4 None admin] REQUEST_METHOD: `PUT` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:53.202185 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703b84d-f273-4bb6-9c5f-86ab5191e7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:53.202449 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703b84d-f273-4bb6-9c5f-86ab5191e7c4 None admin] PATH_INFO: `/v3/projects/ce23217f97fd4906afea681353330615/users/2562343e356e47fc86503e2b9cfa0269/roles/da50bea8a0ef44dfb668a170a3d0a49a` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:53.220625 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703b84d-f273-4bb6-9c5f-86ab5191e7c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce23217f97fd4906afea681353330615, user_id=2562343e356e47fc86503e2b9cfa0269, role_id=da50bea8a0ef44dfb668a170a3d0a49a)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:53.222279 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703b84d-f273-4bb6-9c5f-86ab5191e7c4 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:53.247490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 298/583] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:10:52 2022] PUT /identity/v3/projects/ce23217f97fd4906afea681353330615/users/2562343e356e47fc86503e2b9cfa0269/roles/da50bea8a0ef44dfb668a170a3d0a49a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:10:53.708271 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0107a-1c84-42d0-bd47-570f1f294996 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:53.709427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0107a-1c84-42d0-bd47-570f1f294996 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:53.709427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0107a-1c84-42d0-bd47-570f1f294996 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:53.710486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 286/584] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:53.716965 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03423dd5-4aee-4deb-bb05-f36db492ef2a None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:53.718271 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03423dd5-4aee-4deb-bb05-f36db492ef2a None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:53.719012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03423dd5-4aee-4deb-bb05-f36db492ef2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:53.748299 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-03423dd5-4aee-4deb-bb05-f36db492ef2a None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:53.750764 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-03423dd5-4aee-4deb-bb05-f36db492ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:53.854501 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:53.871156 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 299/585] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:54.215410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0107a-1c84-42d0-bd47-570f1f294996 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:54.344505 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0107a-1c84-42d0-bd47-570f1f294996 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:54.353836 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:54.383677 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda8a45-3086-4a03-b908-0e251f472b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:54.384326 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8a45-3086-4a03-b908-0e251f472b7c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:54.384599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8a45-3086-4a03-b908-0e251f472b7c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:54.384863 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8a45-3086-4a03-b908-0e251f472b7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:54.401585 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda8a45-3086-4a03-b908-0e251f472b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-bfda8a45-3086-4a03-b908-0e251f472b7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:54.406351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:54.407318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:54.408474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 287/586] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:54.414154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03423dd5-4aee-4deb-bb05-f36db492ef2a None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:54.523436 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03423dd5-4aee-4deb-bb05-f36db492ef2a None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:54.559891 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4abab-408c-4ed1-9e06-8e87b18938ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:54.560504 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4abab-408c-4ed1-9e06-8e87b18938ab None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:54.560783 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4abab-408c-4ed1-9e06-8e87b18938ab None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:54.561055 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4abab-408c-4ed1-9e06-8e87b18938ab None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:54.561721 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4abab-408c-4ed1-9e06-8e87b18938ab None admin] RBAC: Adding query filter params (name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:54.562050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4abab-408c-4ed1-9e06-8e87b18938ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:54.563436 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4abab-408c-4ed1-9e06-8e87b18938ab None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:54.572338 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 300/587] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:10:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:54.577568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda8a45-3086-4a03-b908-0e251f472b7c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:54.681021 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda8a45-3086-4a03-b908-0e251f472b7c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:54.714998 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0f244-a0bf-4375-8145-ee795c4d135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:54.715646 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0f244-a0bf-4375-8145-ee795c4d135f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:54.715882 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0f244-a0bf-4375-8145-ee795c4d135f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:54.716153 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0f244-a0bf-4375-8145-ee795c4d135f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:54.727116 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0f244-a0bf-4375-8145-ee795c4d135f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:54.728577 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0f244-a0bf-4375-8145-ee795c4d135f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-23f0f244-a0bf-4375-8145-ee795c4d135f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:54.743071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:54.744072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:54.744955 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:54.744955 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:54.744955 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:54.744955 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 288/588] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:54.750159 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4abab-408c-4ed1-9e06-8e87b18938ab None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:54.809161 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:54.856712 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4abab-408c-4ed1-9e06-8e87b18938ab None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:54.895459 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b1309-97f2-4092-9656-b4c0dcfa9d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:54.896076 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b1309-97f2-4092-9656-b4c0dcfa9d94 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:54.896355 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b1309-97f2-4092-9656-b4c0dcfa9d94 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:54.896628 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b1309-97f2-4092-9656-b4c0dcfa9d94 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:54.897328 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b1309-97f2-4092-9656-b4c0dcfa9d94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:54.897636 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b1309-97f2-4092-9656-b4c0dcfa9d94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:54.899257 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b1309-97f2-4092-9656-b4c0dcfa9d94 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:54.913325 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 301/589] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:54.918911 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0f244-a0bf-4375-8145-ee795c4d135f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:54.942424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:55.026734 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0f244-a0bf-4375-8145-ee795c4d135f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:55.063693 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1f9b9-ca1f-4e79-ae30-98f2178c7b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:55.064380 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1f9b9-ca1f-4e79-ae30-98f2178c7b14 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:55.064659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1f9b9-ca1f-4e79-ae30-98f2178c7b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:55.064929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1f9b9-ca1f-4e79-ae30-98f2178c7b14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:55.073352 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1f9b9-ca1f-4e79-ae30-98f2178c7b14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:55.074840 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1f9b9-ca1f-4e79-ae30-98f2178c7b14 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-55d1f9b9-ca1f-4e79-ae30-98f2178c7b14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:10:55.087035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:55.088023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:55.088963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:55.088963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:55.088963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:10:55.088963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:10:55.088963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:10:55.088963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:10:55.088963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:10:55.088963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:10:55.088963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:10:55.088963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:55.088963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 289/590] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 23 16:10:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:55.094036 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b1309-97f2-4092-9656-b4c0dcfa9d94 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:55.206269 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b1309-97f2-4092-9656-b4c0dcfa9d94 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:55.224514 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:55.244362 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c76e0a-64ed-4379-bab0-81d793ef0fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:55.244990 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76e0a-64ed-4379-bab0-81d793ef0fed None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:55.245268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76e0a-64ed-4379-bab0-81d793ef0fed None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:55.245537 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76e0a-64ed-4379-bab0-81d793ef0fed None admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:55.246305 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c76e0a-64ed-4379-bab0-81d793ef0fed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:55.246606 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c76e0a-64ed-4379-bab0-81d793ef0fed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:55.248050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c76e0a-64ed-4379-bab0-81d793ef0fed None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:55.270164 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 302/591] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 23 16:10:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:55.275782 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1f9b9-ca1f-4e79-ae30-98f2178c7b14 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:55.378810 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:55.391598 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1f9b9-ca1f-4e79-ae30-98f2178c7b14 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:55.440819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db3319-1dbb-49b9-8b1a-05f9a61149b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:55.441826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db3319-1dbb-49b9-8b1a-05f9a61149b8 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:55.442338 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db3319-1dbb-49b9-8b1a-05f9a61149b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:55.442808 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db3319-1dbb-49b9-8b1a-05f9a61149b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:55.519362 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bd107-cdf4-4dfd-bacd-b67a9af27579 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:55.519705 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bd107-cdf4-4dfd-bacd-b67a9af27579 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:55.519918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bd107-cdf4-4dfd-bacd-b67a9af27579 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:55.520792 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db3319-1dbb-49b9-8b1a-05f9a61149b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:55.521609 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 303/592] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:55.522737 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db3319-1dbb-49b9-8b1a-05f9a61149b8 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:55.527508 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37146ab7-d751-4c54-996f-02a50e254d43 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:55.527797 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37146ab7-d751-4c54-996f-02a50e254d43 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:55.528046 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37146ab7-d751-4c54-996f-02a50e254d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:55.547003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-37146ab7-d751-4c54-996f-02a50e254d43 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:55.548241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-37146ab7-d751-4c54-996f-02a50e254d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:55.611670 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:55.623952 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 304/593] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:55.637788 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 290/594] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:55.642945 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37146ab7-d751-4c54-996f-02a50e254d43 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:55.671268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cba730-1b74-4173-860a-43fcd4d45389 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:55.671609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cba730-1b74-4173-860a-43fcd4d45389 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:55.671799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cba730-1b74-4173-860a-43fcd4d45389 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:55.673468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 291/595] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:10:55.678702 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decb0c3-a4e8-45e5-b5ed-48c3177faa30 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:55.678980 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decb0c3-a4e8-45e5-b5ed-48c3177faa30 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:55.679289 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decb0c3-a4e8-45e5-b5ed-48c3177faa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:55.698987 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-4decb0c3-a4e8-45e5-b5ed-48c3177faa30 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:55.700287 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-4decb0c3-a4e8-45e5-b5ed-48c3177faa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:55.748766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37146ab7-d751-4c54-996f-02a50e254d43 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:55.752426 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:55.777359 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 292/596] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:55.787928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4f39-0f63-4703-aae2-3c964baa3ff3 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:55.788222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4f39-0f63-4703-aae2-3c964baa3ff3 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:55.788566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4f39-0f63-4703-aae2-3c964baa3ff3 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:55.789445 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635ad75-e144-4436-9d63-d3c544ec0d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:55.790189 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 293/597] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:55 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:55.794281 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635ad75-e144-4436-9d63-d3c544ec0d39 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:55.794504 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635ad75-e144-4436-9d63-d3c544ec0d39 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:55.794769 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635ad75-e144-4436-9d63-d3c544ec0d39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:55.795410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efcea7-41ce-49ba-b85a-533ace68c04e None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:55.795688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efcea7-41ce-49ba-b85a-533ace68c04e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:55.795960 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efcea7-41ce-49ba-b85a-533ace68c04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:55.810514 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635ad75-e144-4436-9d63-d3c544ec0d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:55.812079 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635ad75-e144-4436-9d63-d3c544ec0d39 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:55.821289 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-21efcea7-41ce-49ba-b85a-533ace68c04e None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:55.823900 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-21efcea7-41ce-49ba-b85a-533ace68c04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-0635ad75-e144-4436-9d63-d3c544ec0d39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:55.830064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:55.831031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:55.831929 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:55.831929 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:55.831929 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:55.835983 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 305/598] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:10:55.837259 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635ad75-e144-4436-9d63-d3c544ec0d39 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:55.914314 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 294/599] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:10:55.965218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635ad75-e144-4436-9d63-d3c544ec0d39 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:55.969220 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efcea7-41ce-49ba-b85a-533ace68c04e None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:56.001543 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85c5be-2b44-4a95-9cdb-c4e2857cd05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:56.002235 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85c5be-2b44-4a95-9cdb-c4e2857cd05c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:56.002514 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85c5be-2b44-4a95-9cdb-c4e2857cd05c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:56.002784 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85c5be-2b44-4a95-9cdb-c4e2857cd05c None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:56.003432 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85c5be-2b44-4a95-9cdb-c4e2857cd05c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:56.003731 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85c5be-2b44-4a95-9cdb-c4e2857cd05c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:56.005392 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85c5be-2b44-4a95-9cdb-c4e2857cd05c None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:56.015145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:56.026037 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 306/600] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:56.027797 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85c5be-2b44-4a95-9cdb-c4e2857cd05c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:56.048304 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:56.087087 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efcea7-41ce-49ba-b85a-533ace68c04e None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:56.123813 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94deb-7b2d-453b-9312-3d6ca8ef4d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:56.124889 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94deb-7b2d-453b-9312-3d6ca8ef4d93 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:56.125414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94deb-7b2d-453b-9312-3d6ca8ef4d93 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:56.125891 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94deb-7b2d-453b-9312-3d6ca8ef4d93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:56.133885 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85c5be-2b44-4a95-9cdb-c4e2857cd05c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:56.137820 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de94deb-7b2d-453b-9312-3d6ca8ef4d93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-4de94deb-7b2d-453b-9312-3d6ca8ef4d93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:56.142926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:56.143861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:56.144735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:56.144735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:56.144735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:56.144735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:56.144735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:56.144735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:56.144735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:56.144735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:56.144735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:56.144735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:56.144735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:56.144735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:56.147775 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 295/601] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:10:56.153197 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94deb-7b2d-453b-9312-3d6ca8ef4d93 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:56.170374 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64966f51-f926-4b25-bc61-81c14cbdcffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:56.170939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64966f51-f926-4b25-bc61-81c14cbdcffa None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:56.171213 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64966f51-f926-4b25-bc61-81c14cbdcffa None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:56.171487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64966f51-f926-4b25-bc61-81c14cbdcffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:56.178848 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64966f51-f926-4b25-bc61-81c14cbdcffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:56.180368 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64966f51-f926-4b25-bc61-81c14cbdcffa None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-64966f51-f926-4b25-bc61-81c14cbdcffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:10:56.192012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:56.192910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:56.193772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:10:56.193772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:10:56.193772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:10:56.193772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:10:56.193772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:10:56.193772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:10:56.193772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:56.193772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:56.193772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 307/602] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:56.194311 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64966f51-f926-4b25-bc61-81c14cbdcffa None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:56.268104 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:56.272085 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94deb-7b2d-453b-9312-3d6ca8ef4d93 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:56.274973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:56.298899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64966f51-f926-4b25-bc61-81c14cbdcffa None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:56.309323 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a367b98-18d6-4ab0-93be-b9e4265f7128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:56.309919 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a367b98-18d6-4ab0-93be-b9e4265f7128 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:56.310179 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a367b98-18d6-4ab0-93be-b9e4265f7128 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:56.310467 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a367b98-18d6-4ab0-93be-b9e4265f7128 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:56.311127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a367b98-18d6-4ab0-93be-b9e4265f7128 None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:56.311419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a367b98-18d6-4ab0-93be-b9e4265f7128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:56.312779 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a367b98-18d6-4ab0-93be-b9e4265f7128 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:56.320973 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 296/603] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:10:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:10:56.321772 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a367b98-18d6-4ab0-93be-b9e4265f7128 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:56.336959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf325e0-89a9-4cb0-b4f1-c15906c2682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:56.337596 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf325e0-89a9-4cb0-b4f1-c15906c2682d None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:56.337870 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf325e0-89a9-4cb0-b4f1-c15906c2682d None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:56.338177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf325e0-89a9-4cb0-b4f1-c15906c2682d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:56.348677 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf325e0-89a9-4cb0-b4f1-c15906c2682d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-dcf325e0-89a9-4cb0-b4f1-c15906c2682d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:56.353928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:56.355078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 308/604] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:56.355916 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf325e0-89a9-4cb0-b4f1-c15906c2682d None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:56.432780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a367b98-18d6-4ab0-93be-b9e4265f7128 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:56.468255 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19aa5f-bec6-4f72-a8f7-3b7dbddbf0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:56.468863 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19aa5f-bec6-4f72-a8f7-3b7dbddbf0ba None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:56.469139 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19aa5f-bec6-4f72-a8f7-3b7dbddbf0ba None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:56.469408 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19aa5f-bec6-4f72-a8f7-3b7dbddbf0ba None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:56.470135 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19aa5f-bec6-4f72-a8f7-3b7dbddbf0ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:56.470450 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19aa5f-bec6-4f72-a8f7-3b7dbddbf0ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:56.471714 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf325e0-89a9-4cb0-b4f1-c15906c2682d None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:56.471862 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19aa5f-bec6-4f72-a8f7-3b7dbddbf0ba None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:56.485033 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 297/605] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:10:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:56.485846 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19aa5f-bec6-4f72-a8f7-3b7dbddbf0ba None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:56.507718 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:56.514802 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157ee98-5da3-462d-bbf1-e6cdfb55d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:56.515441 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157ee98-5da3-462d-bbf1-e6cdfb55d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:56.515716 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157ee98-5da3-462d-bbf1-e6cdfb55d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:56.515983 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157ee98-5da3-462d-bbf1-e6cdfb55d0c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:56.518657 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:56.527265 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157ee98-5da3-462d-bbf1-e6cdfb55d0c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-f157ee98-5da3-462d-bbf1-e6cdfb55d0c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:10:56.532019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:56.533387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 309/606] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:56.534772 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157ee98-5da3-462d-bbf1-e6cdfb55d0c9 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:56.591224 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19aa5f-bec6-4f72-a8f7-3b7dbddbf0ba None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:56.625590 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907bf11-3e86-4adc-9cfa-f52e701d53cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:56.626249 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907bf11-3e86-4adc-9cfa-f52e701d53cb None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:56.626529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907bf11-3e86-4adc-9cfa-f52e701d53cb None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:56.626797 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907bf11-3e86-4adc-9cfa-f52e701d53cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:56.636987 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907bf11-3e86-4adc-9cfa-f52e701d53cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:56.637690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157ee98-5da3-462d-bbf1-e6cdfb55d0c9 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:56.638481 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907bf11-3e86-4adc-9cfa-f52e701d53cb None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-9907bf11-3e86-4adc-9cfa-f52e701d53cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:56.653126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:56.654107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:56.654995 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:56.654995 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:56.654995 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:56.654995 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 298/607] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:56.655224 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907bf11-3e86-4adc-9cfa-f52e701d53cb None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:56.677342 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390d8b8-d7b9-40ee-adf2-03edc0a7acbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:56.678305 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d8b8-d7b9-40ee-adf2-03edc0a7acbb None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:56.678688 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d8b8-d7b9-40ee-adf2-03edc0a7acbb None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:56.678997 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d8b8-d7b9-40ee-adf2-03edc0a7acbb None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:56.679957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390d8b8-d7b9-40ee-adf2-03edc0a7acbb None admin] RBAC: Adding query filter params (name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:56.680342 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390d8b8-d7b9-40ee-adf2-03edc0a7acbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:56.682155 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390d8b8-d7b9-40ee-adf2-03edc0a7acbb None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:56.691446 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 310/608] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:10:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:56.692653 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390d8b8-d7b9-40ee-adf2-03edc0a7acbb None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:56.738664 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:56.754945 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:56.770865 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907bf11-3e86-4adc-9cfa-f52e701d53cb None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:56.796863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390d8b8-d7b9-40ee-adf2-03edc0a7acbb None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:56.803679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7935dc8-c04b-4aea-8125-6b95ec56116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:56.804348 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7935dc8-c04b-4aea-8125-6b95ec56116a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:56.804623 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7935dc8-c04b-4aea-8125-6b95ec56116a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:56.804884 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7935dc8-c04b-4aea-8125-6b95ec56116a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:56.805600 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7935dc8-c04b-4aea-8125-6b95ec56116a None admin] RBAC: Adding query filter params (role.id=da50bea8a0ef44dfb668a170a3d0a49a, scope.project.id=ce23217f97fd4906afea681353330615, user.id=9c6749b0664141529ce43b78fbc836ee) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:56.805902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7935dc8-c04b-4aea-8125-6b95ec56116a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:56.807405 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7935dc8-c04b-4aea-8125-6b95ec56116a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:56.813008 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 299/609] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:56 2022] GET /identity/v3/role_assignments?user.id=9c6749b0664141529ce43b78fbc836ee&scope.project.id=ce23217f97fd4906afea681353330615&role.id=da50bea8a0ef44dfb668a170a3d0a49a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:56.813759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7935dc8-c04b-4aea-8125-6b95ec56116a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:56.833627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1dd95-1ab9-40bc-b7dd-b11b3e4ee79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:56.834249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1dd95-1ab9-40bc-b7dd-b11b3e4ee79e None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:56.834530 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1dd95-1ab9-40bc-b7dd-b11b3e4ee79e None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:56.834801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1dd95-1ab9-40bc-b7dd-b11b3e4ee79e None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:56.835534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1dd95-1ab9-40bc-b7dd-b11b3e4ee79e None admin] RBAC: Adding query filter params (name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:56.835837 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1dd95-1ab9-40bc-b7dd-b11b3e4ee79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:56.837284 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1dd95-1ab9-40bc-b7dd-b11b3e4ee79e None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:56.852043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 311/610] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:10:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:56.852043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1dd95-1ab9-40bc-b7dd-b11b3e4ee79e None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:56.955138 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7935dc8-c04b-4aea-8125-6b95ec56116a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:56.965697 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1dd95-1ab9-40bc-b7dd-b11b3e4ee79e None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:56.986900 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:56.999759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d45256-6b3e-4f00-8258-b774ddbb4b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:57.000372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d45256-6b3e-4f00-8258-b774ddbb4b51 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:57.000643 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d45256-6b3e-4f00-8258-b774ddbb4b51 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:57.000909 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d45256-6b3e-4f00-8258-b774ddbb4b51 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:57.001552 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d45256-6b3e-4f00-8258-b774ddbb4b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:57.001850 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d45256-6b3e-4f00-8258-b774ddbb4b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:57.003580 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d45256-6b3e-4f00-8258-b774ddbb4b51 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:57.006753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:57.007971 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f612e-0fca-49aa-8aca-21bf3c04ebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:57.008610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f612e-0fca-49aa-8aca-21bf3c04ebce None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:57.008885 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f612e-0fca-49aa-8aca-21bf3c04ebce None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:57.009154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f612e-0fca-49aa-8aca-21bf3c04ebce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:57.025291 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 300/611] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:57.026396 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d45256-6b3e-4f00-8258-b774ddbb4b51 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:57.026509 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f612e-0fca-49aa-8aca-21bf3c04ebce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:57.028217 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f612e-0fca-49aa-8aca-21bf3c04ebce None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-228f612e-0fca-49aa-8aca-21bf3c04ebce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:57.049793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:57.050939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:57.051839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:57.051839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:57.051839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:57.051839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 312/612] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:57.052069 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f612e-0fca-49aa-8aca-21bf3c04ebce None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:57.143121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d45256-6b3e-4f00-8258-b774ddbb4b51 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:57.164509 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f612e-0fca-49aa-8aca-21bf3c04ebce None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:57.180625 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8557070-4e8f-47c0-8ba2-7223ea448163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:57.181611 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8557070-4e8f-47c0-8ba2-7223ea448163 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:57.182075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8557070-4e8f-47c0-8ba2-7223ea448163 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:57.182509 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8557070-4e8f-47c0-8ba2-7223ea448163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:57.193864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8557070-4e8f-47c0-8ba2-7223ea448163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:57.195526 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8557070-4e8f-47c0-8ba2-7223ea448163 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:57.203125 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a26b5a-28ee-45ce-8510-91e5da4e0187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:57.203756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a26b5a-28ee-45ce-8510-91e5da4e0187 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:57.204028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a26b5a-28ee-45ce-8510-91e5da4e0187 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:57.204298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a26b5a-28ee-45ce-8510-91e5da4e0187 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-c8557070-4e8f-47c0-8ba2-7223ea448163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:57.211956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:57.213118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:57.214261 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:57.214261 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:57.214261 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:57.215464 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a26b5a-28ee-45ce-8510-91e5da4e0187 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:57.216915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a26b5a-28ee-45ce-8510-91e5da4e0187 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:57.217599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 301/613] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:57.218482 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8557070-4e8f-47c0-8ba2-7223ea448163 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-09a26b5a-28ee-45ce-8510-91e5da4e0187 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:10:57.229167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:57.230241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:57.236242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:57.236242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:57.236242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:10:57.236242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:10:57.236242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:10:57.236242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:10:57.236242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:10:57.236242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:10:57.236242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:10:57.236242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:57.236242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 313/614] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:57.236242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a26b5a-28ee-45ce-8510-91e5da4e0187 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:57.269700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:57.280190 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:57.336983 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8557070-4e8f-47c0-8ba2-7223ea448163 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:57.353176 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a26b5a-28ee-45ce-8510-91e5da4e0187 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:57.374812 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a739f7-8241-44dc-b0cb-62086da53f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:57.375424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a739f7-8241-44dc-b0cb-62086da53f87 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:57.375701 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a739f7-8241-44dc-b0cb-62086da53f87 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:57.375970 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a739f7-8241-44dc-b0cb-62086da53f87 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:57.376641 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a739f7-8241-44dc-b0cb-62086da53f87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:57.376952 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a739f7-8241-44dc-b0cb-62086da53f87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:57.378353 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a739f7-8241-44dc-b0cb-62086da53f87 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:57.390684 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 302/615] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:57.391318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a739f7-8241-44dc-b0cb-62086da53f87 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:57.399463 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b8719-8a5a-4bbf-b796-83917bc93dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:57.400286 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b8719-8a5a-4bbf-b796-83917bc93dfa None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:57.400698 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b8719-8a5a-4bbf-b796-83917bc93dfa None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:57.401105 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b8719-8a5a-4bbf-b796-83917bc93dfa None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:57.401927 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b8719-8a5a-4bbf-b796-83917bc93dfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:57.402410 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b8719-8a5a-4bbf-b796-83917bc93dfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:57.404032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b8719-8a5a-4bbf-b796-83917bc93dfa None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:57.418308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 314/616] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:57.419317 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b8719-8a5a-4bbf-b796-83917bc93dfa None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:57.526316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a739f7-8241-44dc-b0cb-62086da53f87 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:57.533863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:57.538155 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:57.545185 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b8719-8a5a-4bbf-b796-83917bc93dfa None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:57.566912 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff91fd2-84e5-48ed-97b5-42320ab38f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:57.567517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff91fd2-84e5-48ed-97b5-42320ab38f73 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:57.567787 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff91fd2-84e5-48ed-97b5-42320ab38f73 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:57.568053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff91fd2-84e5-48ed-97b5-42320ab38f73 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:57.568839 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff91fd2-84e5-48ed-97b5-42320ab38f73 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:57.569140 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff91fd2-84e5-48ed-97b5-42320ab38f73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:57.570680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff91fd2-84e5-48ed-97b5-42320ab38f73 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:57.585678 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a14294-cf56-4c97-9ef4-90378bad6140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:57.586928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a14294-cf56-4c97-9ef4-90378bad6140 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:57.587209 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a14294-cf56-4c97-9ef4-90378bad6140 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:57.587585 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a14294-cf56-4c97-9ef4-90378bad6140 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:57.589811 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 303/617] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Aug 23 16:10:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:57.590649 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff91fd2-84e5-48ed-97b5-42320ab38f73 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:57.600426 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a14294-cf56-4c97-9ef4-90378bad6140 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:57.602023 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a14294-cf56-4c97-9ef4-90378bad6140 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-65a14294-cf56-4c97-9ef4-90378bad6140 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:10:57.615053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:57.616030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:57.617064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:57.617064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:57.617064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:10:57.617064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:10:57.617064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:10:57.617064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:10:57.617064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:10:57.617064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:10:57.617064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:10:57.617064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:57.617064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 315/618] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:10:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:57.617659 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a14294-cf56-4c97-9ef4-90378bad6140 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:57.708404 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff91fd2-84e5-48ed-97b5-42320ab38f73 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:57.726455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a14294-cf56-4c97-9ef4-90378bad6140 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:57.748509 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd118e-9e98-431f-8592-9db6cf6bbaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:57.749382 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd118e-9e98-431f-8592-9db6cf6bbaa8 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:57.749603 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd118e-9e98-431f-8592-9db6cf6bbaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:57.749871 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd118e-9e98-431f-8592-9db6cf6bbaa8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:57.758370 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd118e-9e98-431f-8592-9db6cf6bbaa8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:57.759917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd118e-9e98-431f-8592-9db6cf6bbaa8 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:57.764856 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29122373-3121-4d2c-89f5-75e354036561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:57.765519 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29122373-3121-4d2c-89f5-75e354036561 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:57.765804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29122373-3121-4d2c-89f5-75e354036561 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:57.766103 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29122373-3121-4d2c-89f5-75e354036561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-fbbd118e-9e98-431f-8592-9db6cf6bbaa8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:10:57.772445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:57.773486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:57.774555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:57.774555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:57.774555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:10:57.774555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:10:57.774555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:10:57.774555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:10:57.774555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:10:57.774555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:10:57.774555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:10:57.774555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:57.774555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 304/619] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:10:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:57.775151 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd118e-9e98-431f-8592-9db6cf6bbaa8 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:57.794465 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:57.811540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:57.852079 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29122373-3121-4d2c-89f5-75e354036561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:57.853533 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29122373-3121-4d2c-89f5-75e354036561 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:57.896853 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd118e-9e98-431f-8592-9db6cf6bbaa8 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:57.932908 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bd7e0-40be-4063-ae70-453d35c3869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:57.933509 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bd7e0-40be-4063-ae70-453d35c3869a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:57.933783 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bd7e0-40be-4063-ae70-453d35c3869a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:57.934074 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bd7e0-40be-4063-ae70-453d35c3869a None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:57.934802 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bd7e0-40be-4063-ae70-453d35c3869a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:57.935102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bd7e0-40be-4063-ae70-453d35c3869a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:57.936528 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bd7e0-40be-4063-ae70-453d35c3869a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:57.954370 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 305/620] 10.222.0.47 () {56 vars in 1139 bytes} [Tue Aug 23 16:10:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:57.955187 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bd7e0-40be-4063-ae70-453d35c3869a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:57.973086 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 316/621] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:57.973977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29122373-3121-4d2c-89f5-75e354036561 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:58.032186 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:58.054800 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:58.072148 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bd7e0-40be-4063-ae70-453d35c3869a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:58.088678 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29122373-3121-4d2c-89f5-75e354036561 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:58.112469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5266-815c-4176-98c7-f63a3388f3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:58.113067 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5266-815c-4176-98c7-f63a3388f3bd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:58.113341 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5266-815c-4176-98c7-f63a3388f3bd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:58.113604 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5266-815c-4176-98c7-f63a3388f3bd None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:58.114354 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a5266-815c-4176-98c7-f63a3388f3bd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:58.114760 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a5266-815c-4176-98c7-f63a3388f3bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:58.116215 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a5266-815c-4176-98c7-f63a3388f3bd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:58.126304 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833e915-1738-41f7-9f8b-5b28af57d2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:58.126910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833e915-1738-41f7-9f8b-5b28af57d2e3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:58.127192 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833e915-1738-41f7-9f8b-5b28af57d2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:58.127461 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833e915-1738-41f7-9f8b-5b28af57d2e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:58.138613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 306/622] 10.222.0.47 () {56 vars in 1137 bytes} [Tue Aug 23 16:10:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:58.139980 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5266-815c-4176-98c7-f63a3388f3bd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:58.197661 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833e915-1738-41f7-9f8b-5b28af57d2e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:58.199138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833e915-1738-41f7-9f8b-5b28af57d2e3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:58.245069 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5266-815c-4176-98c7-f63a3388f3bd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:58.253803 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:58.284363 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51a51a-9cec-48be-be90-1cc008a58a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:58.285262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51a51a-9cec-48be-be90-1cc008a58a5e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:58.285561 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51a51a-9cec-48be-be90-1cc008a58a5e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:58.285833 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51a51a-9cec-48be-be90-1cc008a58a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:58.298695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51a51a-9cec-48be-be90-1cc008a58a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:58.300417 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51a51a-9cec-48be-be90-1cc008a58a5e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:58.303025 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:58.309893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 317/623] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:58.309893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833e915-1738-41f7-9f8b-5b28af57d2e3 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-2c51a51a-9cec-48be-be90-1cc008a58a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:58.318216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:58.319176 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:58.320103 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:58.320103 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:58.320103 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:58.320103 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 307/624] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:58.320351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51a51a-9cec-48be-be90-1cc008a58a5e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:58.420577 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833e915-1738-41f7-9f8b-5b28af57d2e3 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:58.429595 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51a51a-9cec-48be-be90-1cc008a58a5e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:58.455779 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7d612-ebae-4282-bb15-c38dcd7f070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:58.456388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d612-ebae-4282-bb15-c38dcd7f070d None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:58.456667 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d612-ebae-4282-bb15-c38dcd7f070d None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:58.456938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d612-ebae-4282-bb15-c38dcd7f070d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:58.466386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b65e7-6fe0-45fe-8db7-070367b6cdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:58.467091 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b65e7-6fe0-45fe-8db7-070367b6cdec None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:58.467370 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b65e7-6fe0-45fe-8db7-070367b6cdec None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:58.467664 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b65e7-6fe0-45fe-8db7-070367b6cdec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:58.479418 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:58.480516 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b65e7-6fe0-45fe-8db7-070367b6cdec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:58.482161 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b65e7-6fe0-45fe-8db7-070367b6cdec None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-907b65e7-6fe0-45fe-8db7-070367b6cdec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:58.503102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:58.504049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:58.504937 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:58.504937 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:58.504937 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:58.504937 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 308/625] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:58.505531 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b65e7-6fe0-45fe-8db7-070367b6cdec None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:58.540948 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7d612-ebae-4282-bb15-c38dcd7f070d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:58.542979 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7d612-ebae-4282-bb15-c38dcd7f070d None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:58.554667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:58.610062 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b65e7-6fe0-45fe-8db7-070367b6cdec None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:58.647560 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378d401-b5d0-421a-91f2-3db547ab9dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:58.648198 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378d401-b5d0-421a-91f2-3db547ab9dfd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:58.648530 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378d401-b5d0-421a-91f2-3db547ab9dfd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:58.648741 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378d401-b5d0-421a-91f2-3db547ab9dfd None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:58.649374 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378d401-b5d0-421a-91f2-3db547ab9dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:58.649885 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378d401-b5d0-421a-91f2-3db547ab9dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:58.651109 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378d401-b5d0-421a-91f2-3db547ab9dfd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:58.654030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 318/626] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:10:58.654518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7d612-ebae-4282-bb15-c38dcd7f070d None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:58.669123 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 309/627] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:58.671108 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378d401-b5d0-421a-91f2-3db547ab9dfd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:58.711043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:58.761490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7d612-ebae-4282-bb15-c38dcd7f070d None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:58.782027 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378d401-b5d0-421a-91f2-3db547ab9dfd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:58.792264 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:58.797053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca9616-b291-4815-a09d-c81f3f1e3664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:58.797663 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca9616-b291-4815-a09d-c81f3f1e3664 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:58.797939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca9616-b291-4815-a09d-c81f3f1e3664 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:58.798235 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca9616-b291-4815-a09d-c81f3f1e3664 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:58.798865 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca9616-b291-4815-a09d-c81f3f1e3664 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:58.799159 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca9616-b291-4815-a09d-c81f3f1e3664 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:58.800516 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca9616-b291-4815-a09d-c81f3f1e3664 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:58.811697 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 319/628] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:58.812482 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca9616-b291-4815-a09d-c81f3f1e3664 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:58.827460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066df18-8f95-4a85-9353-4e47e5568cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:58.828904 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066df18-8f95-4a85-9353-4e47e5568cb4 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:58.829433 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066df18-8f95-4a85-9353-4e47e5568cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:58.829745 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066df18-8f95-4a85-9353-4e47e5568cb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:58.840903 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066df18-8f95-4a85-9353-4e47e5568cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:58.842520 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066df18-8f95-4a85-9353-4e47e5568cb4 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-7066df18-8f95-4a85-9353-4e47e5568cb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:10:58.859083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:58.860242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:10:58.861161 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:10:58.861161 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:10:58.861161 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:58.861161 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 310/629] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:58.861161 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066df18-8f95-4a85-9353-4e47e5568cb4 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:58.934520 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca9616-b291-4815-a09d-c81f3f1e3664 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:58.948142 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:58.969458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273870e-3c5c-4550-9b4e-3904180e7581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:58.970088 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273870e-3c5c-4550-9b4e-3904180e7581 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:58.970360 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273870e-3c5c-4550-9b4e-3904180e7581 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:58.970633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273870e-3c5c-4550-9b4e-3904180e7581 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:58.977818 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273870e-3c5c-4550-9b4e-3904180e7581 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:58.979309 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273870e-3c5c-4550-9b4e-3904180e7581 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:58.985134 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066df18-8f95-4a85-9353-4e47e5568cb4 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-1273870e-3c5c-4550-9b4e-3904180e7581 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:10:58.991110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:58.992095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:59.000450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:10:59.000450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:10:59.000450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:10:59.000450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:10:59.000450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:10:59.000450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:10:59.000450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:59.000450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:10:59.000450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 320/630] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:59.000450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273870e-3c5c-4550-9b4e-3904180e7581 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:59.033080 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874fad3-5bca-4e05-996f-46c961c0c5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:59.033719 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874fad3-5bca-4e05-996f-46c961c0c5fd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:59.034155 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874fad3-5bca-4e05-996f-46c961c0c5fd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:59.034399 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874fad3-5bca-4e05-996f-46c961c0c5fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:59.042399 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874fad3-5bca-4e05-996f-46c961c0c5fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:59.043954 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874fad3-5bca-4e05-996f-46c961c0c5fd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-3874fad3-5bca-4e05-996f-46c961c0c5fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:10:59.057448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:59.058841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:59.059759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:10:59.059759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:10:59.059759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:10:59.059759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:10:59.059759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:10:59.059759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:10:59.059759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:59.059759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:59.059759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 311/631] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:59.060281 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874fad3-5bca-4e05-996f-46c961c0c5fd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:59.082676 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:59.117554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273870e-3c5c-4550-9b4e-3904180e7581 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:59.152653 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53074e1f-284a-4623-b3f3-84e5ea9273de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:59.153261 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53074e1f-284a-4623-b3f3-84e5ea9273de None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:59.153532 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53074e1f-284a-4623-b3f3-84e5ea9273de None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:59.153800 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53074e1f-284a-4623-b3f3-84e5ea9273de None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:59.154470 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53074e1f-284a-4623-b3f3-84e5ea9273de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:59.154769 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53074e1f-284a-4623-b3f3-84e5ea9273de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:59.156175 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53074e1f-284a-4623-b3f3-84e5ea9273de None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:59.165053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874fad3-5bca-4e05-996f-46c961c0c5fd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:59.168757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 321/632] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:59.169582 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53074e1f-284a-4623-b3f3-84e5ea9273de None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:59.199529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab90661-2477-44df-8abd-406c84d37b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:59.200132 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab90661-2477-44df-8abd-406c84d37b47 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:59.200367 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:59.200480 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab90661-2477-44df-8abd-406c84d37b47 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:59.200679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab90661-2477-44df-8abd-406c84d37b47 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:59.201499 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab90661-2477-44df-8abd-406c84d37b47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:59.201621 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab90661-2477-44df-8abd-406c84d37b47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:59.203749 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab90661-2477-44df-8abd-406c84d37b47 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:59.216178 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 312/633] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:59.217315 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474696f-54e5-461f-a2b3-fdb6fd48be80 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:59.217660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474696f-54e5-461f-a2b3-fdb6fd48be80 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:59.217909 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474696f-54e5-461f-a2b3-fdb6fd48be80 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:59.222047 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 313/634] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:10:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:10:59.222047 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474696f-54e5-461f-a2b3-fdb6fd48be80 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:59.273547 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53074e1f-284a-4623-b3f3-84e5ea9273de None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:59.302314 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:59.308601 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74db7d-7453-41c5-a533-d16ca463ab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:59.309207 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74db7d-7453-41c5-a533-d16ca463ab0f None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:59.309486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74db7d-7453-41c5-a533-d16ca463ab0f None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:59.309747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74db7d-7453-41c5-a533-d16ca463ab0f None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:59.310472 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74db7d-7453-41c5-a533-d16ca463ab0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:59.310769 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74db7d-7453-41c5-a533-d16ca463ab0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:59.312199 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74db7d-7453-41c5-a533-d16ca463ab0f None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:59.324991 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 322/635] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:59.325920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74db7d-7453-41c5-a533-d16ca463ab0f None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:59.326814 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474696f-54e5-461f-a2b3-fdb6fd48be80 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:59.365296 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffe95d-3c58-4dad-a55a-0b00352409cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:59.365924 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffe95d-3c58-4dad-a55a-0b00352409cb None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:59.366240 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffe95d-3c58-4dad-a55a-0b00352409cb None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:59.366506 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffe95d-3c58-4dad-a55a-0b00352409cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:59.373301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffe95d-3c58-4dad-a55a-0b00352409cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:59.374815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffe95d-3c58-4dad-a55a-0b00352409cb None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-beffe95d-3c58-4dad-a55a-0b00352409cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:10:59.386096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:10:59.387195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:10:59.388281 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:10:59.388281 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:10:59.388281 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:10:59.388281 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:10:59.388281 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:10:59.388281 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:10:59.388281 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:10:59.388281 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:10:59.388281 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 314/636] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:10:59.388876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c62b92-cd43-4345-a596-37fe3f89d688 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:59.388998 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c62b92-cd43-4345-a596-37fe3f89d688 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:59.389272 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c62b92-cd43-4345-a596-37fe3f89d688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:59.407034 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-99c62b92-cd43-4345-a596-37fe3f89d688 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:10:59.408572 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-99c62b92-cd43-4345-a596-37fe3f89d688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:10:59.425065 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:59.434699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74db7d-7453-41c5-a533-d16ca463ab0f None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:59.479123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da5019-6adc-475d-be4e-ee3da1548add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:59.479730 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da5019-6adc-475d-be4e-ee3da1548add None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:59.480006 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da5019-6adc-475d-be4e-ee3da1548add None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:59.480322 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da5019-6adc-475d-be4e-ee3da1548add None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:59.481054 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da5019-6adc-475d-be4e-ee3da1548add None admin] RBAC: Adding query filter params (role.id=da50bea8a0ef44dfb668a170a3d0a49a, scope.project.id=ce23217f97fd4906afea681353330615, user.id=5ff3c93c8cca444cba0362960b57a6bc) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:59.481524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da5019-6adc-475d-be4e-ee3da1548add None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:59.482821 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da5019-6adc-475d-be4e-ee3da1548add None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:59.485777 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 315/637] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:10:59.486660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c62b92-cd43-4345-a596-37fe3f89d688 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:59.489053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 323/638] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:59 2022] GET /identity/v3/role_assignments?user.id=5ff3c93c8cca444cba0362960b57a6bc&scope.project.id=ce23217f97fd4906afea681353330615&role.id=da50bea8a0ef44dfb668a170a3d0a49a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:59.490019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da5019-6adc-475d-be4e-ee3da1548add None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:59.582802 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:59.624123 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c62b92-cd43-4345-a596-37fe3f89d688 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:59.633391 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da5019-6adc-475d-be4e-ee3da1548add None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:59.671317 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16c5aa-2dd9-4086-80fe-36806744e3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:59.672022 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c5aa-2dd9-4086-80fe-36806744e3cd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:59.672359 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c5aa-2dd9-4086-80fe-36806744e3cd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:59.672711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c5aa-2dd9-4086-80fe-36806744e3cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:59.673482 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16c5aa-2dd9-4086-80fe-36806744e3cd None admin] RBAC: Adding query filter params (role.id=da50bea8a0ef44dfb668a170a3d0a49a, scope.project.id=ce23217f97fd4906afea681353330615, user.id=2562343e356e47fc86503e2b9cfa0269) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:59.673850 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16c5aa-2dd9-4086-80fe-36806744e3cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:59.675469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16c5aa-2dd9-4086-80fe-36806744e3cd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:59.675997 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84a422-4e3a-4766-95b5-4ee19355a913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:59.676801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84a422-4e3a-4766-95b5-4ee19355a913 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:59.677268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84a422-4e3a-4766-95b5-4ee19355a913 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:59.677818 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84a422-4e3a-4766-95b5-4ee19355a913 None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:59.679044 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84a422-4e3a-4766-95b5-4ee19355a913 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:59.679525 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84a422-4e3a-4766-95b5-4ee19355a913 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:59.681127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84a422-4e3a-4766-95b5-4ee19355a913 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:59.682969 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 316/639] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:59 2022] GET /identity/v3/role_assignments?user.id=2562343e356e47fc86503e2b9cfa0269&scope.project.id=ce23217f97fd4906afea681353330615&role.id=da50bea8a0ef44dfb668a170a3d0a49a => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:59.696285 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 324/640] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:59.702577 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16c5aa-2dd9-4086-80fe-36806744e3cd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:59.811967 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84a422-4e3a-4766-95b5-4ee19355a913 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:10:59.821181 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16c5aa-2dd9-4086-80fe-36806744e3cd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:59.836277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:59.858472 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:10:59.871660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515c03-530c-40e2-b735-20bb9c674b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:59.872685 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515c03-530c-40e2-b735-20bb9c674b1e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:59.874147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515c03-530c-40e2-b735-20bb9c674b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:59.874147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515c03-530c-40e2-b735-20bb9c674b1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:59.874147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c515c03-530c-40e2-b735-20bb9c674b1e None admin] RBAC: Adding query filter params (role.id=da50bea8a0ef44dfb668a170a3d0a49a, scope.project.id=ce23217f97fd4906afea681353330615, user.id=f2225825e32a488ea5bca33c00bb1b5c) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:10:59.875694 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c515c03-530c-40e2-b735-20bb9c674b1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:10:59.876195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c515c03-530c-40e2-b735-20bb9c674b1e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:10:59.883257 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 317/641] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:10:59 2022] GET /identity/v3/role_assignments?user.id=f2225825e32a488ea5bca33c00bb1b5c&scope.project.id=ce23217f97fd4906afea681353330615&role.id=da50bea8a0ef44dfb668a170a3d0a49a => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:10:59.953992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84a422-4e3a-4766-95b5-4ee19355a913 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:10:59.998576 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f775e-b9dc-47c0-854c-8e74f0e32a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:10:59.999486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f775e-b9dc-47c0-854c-8e74f0e32a9b None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:59.999909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f775e-b9dc-47c0-854c-8e74f0e32a9b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:00.000323 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f775e-b9dc-47c0-854c-8e74f0e32a9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:00.013239 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f775e-b9dc-47c0-854c-8e74f0e32a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-a06f775e-b9dc-47c0-854c-8e74f0e32a9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:00.018727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:00.020007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:00.021147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:00.021147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:00.021147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:00.021147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:00.021147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:00.021147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:00.021147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:00.021147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:00.021147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:00.021147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:00.021147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:00.021147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:00.023749 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 325/642] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:10:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:00.032470 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515c03-530c-40e2-b735-20bb9c674b1e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:00.146289 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515c03-530c-40e2-b735-20bb9c674b1e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:00.182363 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba115a14-ac09-4055-9f9b-ec21c22b5291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:00.183164 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba115a14-ac09-4055-9f9b-ec21c22b5291 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:00.183665 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba115a14-ac09-4055-9f9b-ec21c22b5291 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:00.184026 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba115a14-ac09-4055-9f9b-ec21c22b5291 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:00.184793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba115a14-ac09-4055-9f9b-ec21c22b5291 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:00.185188 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba115a14-ac09-4055-9f9b-ec21c22b5291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:00.186691 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba115a14-ac09-4055-9f9b-ec21c22b5291 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:00.200425 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 318/643] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:00.201977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f775e-b9dc-47c0-854c-8e74f0e32a9b None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:00.283884 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:00.308408 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f775e-b9dc-47c0-854c-8e74f0e32a9b None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:00.343858 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce1ea2-6b18-45f7-ad2f-2432729b2992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:00.344645 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce1ea2-6b18-45f7-ad2f-2432729b2992 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:00.345012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce1ea2-6b18-45f7-ad2f-2432729b2992 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:00.345373 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce1ea2-6b18-45f7-ad2f-2432729b2992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:00.356541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce1ea2-6b18-45f7-ad2f-2432729b2992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:00.358156 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce1ea2-6b18-45f7-ad2f-2432729b2992 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-34ce1ea2-6b18-45f7-ad2f-2432729b2992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:11:00.373045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:00.374227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:11:00.375111 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:11:00.375111 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:00.375111 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:00.378159 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 326/644] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:00.381054 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba115a14-ac09-4055-9f9b-ec21c22b5291 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:00.443514 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:00.491251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba115a14-ac09-4055-9f9b-ec21c22b5291 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:00.529209 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a6fef-f650-4a0a-8ae6-ad2f19f9bfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:00.530149 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a6fef-f650-4a0a-8ae6-ad2f19f9bfcc None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:00.530574 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a6fef-f650-4a0a-8ae6-ad2f19f9bfcc None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:00.531002 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a6fef-f650-4a0a-8ae6-ad2f19f9bfcc None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:00.531794 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a6fef-f650-4a0a-8ae6-ad2f19f9bfcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:00.532250 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a6fef-f650-4a0a-8ae6-ad2f19f9bfcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:00.534188 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a6fef-f650-4a0a-8ae6-ad2f19f9bfcc None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:00.547186 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 319/645] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:00.555274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce1ea2-6b18-45f7-ad2f-2432729b2992 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:00.659018 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce1ea2-6b18-45f7-ad2f-2432729b2992 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:00.688588 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:00.698386 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab32b7-b19f-4240-be43-fd2d9569a754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:00.699004 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab32b7-b19f-4240-be43-fd2d9569a754 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:00.699286 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab32b7-b19f-4240-be43-fd2d9569a754 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:00.699552 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab32b7-b19f-4240-be43-fd2d9569a754 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:00.707610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab32b7-b19f-4240-be43-fd2d9569a754 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:00.709117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab32b7-b19f-4240-be43-fd2d9569a754 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-54ab32b7-b19f-4240-be43-fd2d9569a754 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:11:00.720915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:00.721911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:00.722917 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:00.722917 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:00.722917 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:11:00.722917 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:11:00.722917 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:11:00.722917 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:11:00.722917 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:11:00.722917 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:11:00.722917 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:11:00.722917 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:00.726131 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 327/646] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 23 16:11:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:00.731142 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a6fef-f650-4a0a-8ae6-ad2f19f9bfcc None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:00.838836 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a6fef-f650-4a0a-8ae6-ad2f19f9bfcc None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:00.857375 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:00.875384 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ef0d-8848-4a4a-9c68-0131aff2019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:00.876037 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ef0d-8848-4a4a-9c68-0131aff2019d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:00.876285 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ef0d-8848-4a4a-9c68-0131aff2019d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:00.876541 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ef0d-8848-4a4a-9c68-0131aff2019d None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:00.877297 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472ef0d-8848-4a4a-9c68-0131aff2019d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:00.877602 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472ef0d-8848-4a4a-9c68-0131aff2019d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:00.879090 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472ef0d-8848-4a4a-9c68-0131aff2019d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:00.898903 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 320/647] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 23 16:11:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:00.904717 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab32b7-b19f-4240-be43-fd2d9569a754 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:01.016690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab32b7-b19f-4240-be43-fd2d9569a754 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:01.053203 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d7225-abf1-46e9-97af-e6faf7a437c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:01.054255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7225-abf1-46e9-97af-e6faf7a437c3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:01.054755 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7225-abf1-46e9-97af-e6faf7a437c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:01.055245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7225-abf1-46e9-97af-e6faf7a437c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:01.116658 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:01.131220 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d7225-abf1-46e9-97af-e6faf7a437c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:01.133070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d7225-abf1-46e9-97af-e6faf7a437c3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:01.243850 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 328/648] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:01.247213 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ef0d-8848-4a4a-9c68-0131aff2019d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:01.352472 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ef0d-8848-4a4a-9c68-0131aff2019d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:01.387879 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd90fa1-b11d-42a4-906d-300877107b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:01.388540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd90fa1-b11d-42a4-906d-300877107b3c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:01.388819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd90fa1-b11d-42a4-906d-300877107b3c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:01.389091 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd90fa1-b11d-42a4-906d-300877107b3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:01.400306 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd90fa1-b11d-42a4-906d-300877107b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:01.401779 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd90fa1-b11d-42a4-906d-300877107b3c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-2bd90fa1-b11d-42a4-906d-300877107b3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:11:01.417265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:01.418301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:11:01.419722 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:11:01.419722 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:01.419722 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:01.419722 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 321/649] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:01.425752 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d7225-abf1-46e9-97af-e6faf7a437c3 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:01.530438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:01.536521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d7225-abf1-46e9-97af-e6faf7a437c3 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:01.573432 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb11716-1ff3-4c5f-a0ea-ea0ca80bc0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:01.574501 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb11716-1ff3-4c5f-a0ea-ea0ca80bc0a7 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:01.574974 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb11716-1ff3-4c5f-a0ea-ea0ca80bc0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:01.575437 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb11716-1ff3-4c5f-a0ea-ea0ca80bc0a7 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:01.576283 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb11716-1ff3-4c5f-a0ea-ea0ca80bc0a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:01.576849 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb11716-1ff3-4c5f-a0ea-ea0ca80bc0a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:01.578455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb11716-1ff3-4c5f-a0ea-ea0ca80bc0a7 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:01.595537 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 329/650] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:01.597288 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd90fa1-b11d-42a4-906d-300877107b3c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:01.631408 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:01.708404 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd90fa1-b11d-42a4-906d-300877107b3c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:01.749472 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e195a02-049b-4d89-a737-ea98151bf976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:01.750172 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195a02-049b-4d89-a737-ea98151bf976 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:01.750455 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195a02-049b-4d89-a737-ea98151bf976 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:01.750728 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195a02-049b-4d89-a737-ea98151bf976 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:01.758787 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e195a02-049b-4d89-a737-ea98151bf976 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:01.760595 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e195a02-049b-4d89-a737-ea98151bf976 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-3e195a02-049b-4d89-a737-ea98151bf976 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:11:01.773046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:01.774018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:01.775078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:11:01.775078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:11:01.775078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:11:01.775078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:11:01.775078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:11:01.775078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:11:01.775078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:11:01.775078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:01.775078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 322/651] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:01.781982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb11716-1ff3-4c5f-a0ea-ea0ca80bc0a7 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:01.892247 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb11716-1ff3-4c5f-a0ea-ea0ca80bc0a7 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:01.903983 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c692c0-1954-4a22-a2b1-9983f9c872cd None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:01.904542 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c692c0-1954-4a22-a2b1-9983f9c872cd None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:01.904542 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c692c0-1954-4a22-a2b1-9983f9c872cd None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:01.906236 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 323/652] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:01.912438 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9bb3f-9551-4e1b-b7ee-68e144cbb0bf None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:01.912868 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9bb3f-9551-4e1b-b7ee-68e144cbb0bf None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:01.913237 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9bb3f-9551-4e1b-b7ee-68e144cbb0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:01.932036 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-19f9bb3f-9551-4e1b-b7ee-68e144cbb0bf None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:01.932478 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460374a6-19a0-423a-b0ca-4f3588a261ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:01.933228 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-19f9bb3f-9551-4e1b-b7ee-68e144cbb0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:01.933863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460374a6-19a0-423a-b0ca-4f3588a261ea None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:01.934551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460374a6-19a0-423a-b0ca-4f3588a261ea None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:01.935013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460374a6-19a0-423a-b0ca-4f3588a261ea None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:01.935995 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460374a6-19a0-423a-b0ca-4f3588a261ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:01.936559 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460374a6-19a0-423a-b0ca-4f3588a261ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:01.938236 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460374a6-19a0-423a-b0ca-4f3588a261ea None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:01.957467 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 330/653] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:11:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:01.959190 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460374a6-19a0-423a-b0ca-4f3588a261ea None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:01.990649 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:02.018306 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 324/654] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:02.078150 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460374a6-19a0-423a-b0ca-4f3588a261ea None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:02.094129 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa954fe5-fb1a-42b8-8947-d5541a78d54b None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:02.094480 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa954fe5-fb1a-42b8-8947-d5541a78d54b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:02.094689 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa954fe5-fb1a-42b8-8947-d5541a78d54b None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:02.096333 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 325/655] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:02.101737 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25a672-05eb-4fa9-8e42-92d2facbb5c6 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:02.101975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25a672-05eb-4fa9-8e42-92d2facbb5c6 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:02.102279 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25a672-05eb-4fa9-8e42-92d2facbb5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:02.117079 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a1b2a-52e7-4f24-a37f-72167535d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:02.118085 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a1b2a-52e7-4f24-a37f-72167535d20f None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:02.118570 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a1b2a-52e7-4f24-a37f-72167535d20f None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:02.118981 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a1b2a-52e7-4f24-a37f-72167535d20f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:02.119900 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a1b2a-52e7-4f24-a37f-72167535d20f None admin] RBAC: Adding query filter params (role.id=5756384fa8d842139e2f1fc44c5088bd, scope.project.id=ce23217f97fd4906afea681353330615, user.id=9c6749b0664141529ce43b78fbc836ee) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:02.120347 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a1b2a-52e7-4f24-a37f-72167535d20f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:02.122091 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a1b2a-52e7-4f24-a37f-72167535d20f None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:02.122608 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-9a25a672-05eb-4fa9-8e42-92d2facbb5c6 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:02.123911 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-9a25a672-05eb-4fa9-8e42-92d2facbb5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:02.128747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 331/656] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:01 2022] GET /identity/v3/role_assignments?user.id=9c6749b0664141529ce43b78fbc836ee&scope.project.id=ce23217f97fd4906afea681353330615&role.id=5756384fa8d842139e2f1fc44c5088bd => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:02.143578 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:02.218567 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 326/657] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:02.340928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942f219-206b-4074-9fc6-7bcbabc57378 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:02.341265 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942f219-206b-4074-9fc6-7bcbabc57378 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:02.341498 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942f219-206b-4074-9fc6-7bcbabc57378 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:02.343166 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 332/658] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:02.348944 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb718e8-5d79-40ad-82db-78269b88b1e5 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:02.349230 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb718e8-5d79-40ad-82db-78269b88b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:02.349504 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb718e8-5d79-40ad-82db-78269b88b1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:02.370221 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-dfb718e8-5d79-40ad-82db-78269b88b1e5 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:02.371426 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-dfb718e8-5d79-40ad-82db-78269b88b1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:02.384696 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942f219-206b-4074-9fc6-7bcbabc57378 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:02.449423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 327/659] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:02.481551 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:02.517225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942f219-206b-4074-9fc6-7bcbabc57378 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:02.560129 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ac2e4-e07b-4d83-975c-05b74ccb6066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:02.560833 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ac2e4-e07b-4d83-975c-05b74ccb6066 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:02.561114 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ac2e4-e07b-4d83-975c-05b74ccb6066 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:02.561662 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ac2e4-e07b-4d83-975c-05b74ccb6066 None admin] PATH_INFO: `/v3/services/image` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:02.562381 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ac2e4-e07b-4d83-975c-05b74ccb6066 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:02.563778 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ac2e4-e07b-4d83-975c-05b74ccb6066 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-682ac2e4-e07b-4d83-975c-05b74ccb6066 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:02.585630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:02.586982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:02.587969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 333/660] 10.222.0.47 () {56 vars in 1105 bytes} [Tue Aug 23 16:11:02 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:02.591329 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb718e8-5d79-40ad-82db-78269b88b1e5 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:02.594404 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ac2e4-e07b-4d83-975c-05b74ccb6066 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:02.717615 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ac2e4-e07b-4d83-975c-05b74ccb6066 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:02.717992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:02.742839 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb718e8-5d79-40ad-82db-78269b88b1e5 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:02.756786 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bdd73-b8a1-428d-bc4f-ddcb43c027d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:02.757405 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bdd73-b8a1-428d-bc4f-ddcb43c027d1 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:02.757714 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bdd73-b8a1-428d-bc4f-ddcb43c027d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:02.758027 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bdd73-b8a1-428d-bc4f-ddcb43c027d1 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:02.758663 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bdd73-b8a1-428d-bc4f-ddcb43c027d1 None admin] RBAC: Adding query filter params (name=image) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:02.758965 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bdd73-b8a1-428d-bc4f-ddcb43c027d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:02.760365 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bdd73-b8a1-428d-bc4f-ddcb43c027d1 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:02.762393 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:02.770651 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 334/661] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:02.774773 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bdd73-b8a1-428d-bc4f-ddcb43c027d1 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:02.794842 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095bbd0-c604-4476-b55c-21de83aa4ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:02.795807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095bbd0-c604-4476-b55c-21de83aa4ae6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:02.796213 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095bbd0-c604-4476-b55c-21de83aa4ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:02.796594 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095bbd0-c604-4476-b55c-21de83aa4ae6 None admin] PATH_INFO: `/v3/services/network` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:02.797411 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095bbd0-c604-4476-b55c-21de83aa4ae6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:02.799769 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095bbd0-c604-4476-b55c-21de83aa4ae6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-9095bbd0-c604-4476-b55c-21de83aa4ae6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:02.813673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:02.815975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:02.817410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 328/662] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:02 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:02.822629 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095bbd0-c604-4476-b55c-21de83aa4ae6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:02.915593 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bdd73-b8a1-428d-bc4f-ddcb43c027d1 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:02.964238 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c59c41-f3d8-4b7e-a775-9b0db320a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:02.964936 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c59c41-f3d8-4b7e-a775-9b0db320a006 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:02.965199 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c59c41-f3d8-4b7e-a775-9b0db320a006 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:02.965380 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c59c41-f3d8-4b7e-a775-9b0db320a006 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:02.966116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c59c41-f3d8-4b7e-a775-9b0db320a006 None admin] RBAC: Adding query filter params (type=image) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:02.966338 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c59c41-f3d8-4b7e-a775-9b0db320a006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:02.967763 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c59c41-f3d8-4b7e-a775-9b0db320a006 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:02.970719 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095bbd0-c604-4476-b55c-21de83aa4ae6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:02.982322 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 335/663] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:02.982322 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c59c41-f3d8-4b7e-a775-9b0db320a006 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:03.020162 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc99c2-dc51-4f28-b048-5b46995407a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:03.020979 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc99c2-dc51-4f28-b048-5b46995407a6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:03.021406 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc99c2-dc51-4f28-b048-5b46995407a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:03.021778 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc99c2-dc51-4f28-b048-5b46995407a6 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:03.022640 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc99c2-dc51-4f28-b048-5b46995407a6 None admin] RBAC: Adding query filter params (name=network) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:03.023346 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc99c2-dc51-4f28-b048-5b46995407a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:03.025549 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc99c2-dc51-4f28-b048-5b46995407a6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:03.038519 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 329/664] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:03.039892 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc99c2-dc51-4f28-b048-5b46995407a6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:03.053738 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:03.102841 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:03.179861 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c59c41-f3d8-4b7e-a775-9b0db320a006 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:03.232751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc99c2-dc51-4f28-b048-5b46995407a6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:03.241733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9401821-a4ce-428e-abc2-e83774b5fbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:03.242759 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9401821-a4ce-428e-abc2-e83774b5fbcb None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:03.243180 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9401821-a4ce-428e-abc2-e83774b5fbcb None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:03.243591 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9401821-a4ce-428e-abc2-e83774b5fbcb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:03.244325 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9401821-a4ce-428e-abc2-e83774b5fbcb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:03.246139 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9401821-a4ce-428e-abc2-e83774b5fbcb None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-b9401821-a4ce-428e-abc2-e83774b5fbcb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:03.263487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:03.264562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:11:03.265438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:03.272959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 336/665] 10.222.0.47 () {56 vars in 1129 bytes} [Tue Aug 23 16:11:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:03.274761 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9401821-a4ce-428e-abc2-e83774b5fbcb None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:03.295428 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433baf10-076c-4d82-a7ec-b6964d9b09bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:03.296583 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433baf10-076c-4d82-a7ec-b6964d9b09bf None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:03.297192 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433baf10-076c-4d82-a7ec-b6964d9b09bf None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:03.297687 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433baf10-076c-4d82-a7ec-b6964d9b09bf None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:03.298704 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433baf10-076c-4d82-a7ec-b6964d9b09bf None admin] RBAC: Adding query filter params (type=network) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:03.299244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433baf10-076c-4d82-a7ec-b6964d9b09bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:03.301121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433baf10-076c-4d82-a7ec-b6964d9b09bf None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:03.309265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 330/666] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:03.478348 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9401821-a4ce-428e-abc2-e83774b5fbcb None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:03.546425 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:03.549323 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78f862-e194-4afd-9897-deaf190b26cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:03.550455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78f862-e194-4afd-9897-deaf190b26cc None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:03.550739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78f862-e194-4afd-9897-deaf190b26cc None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:03.551023 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78f862-e194-4afd-9897-deaf190b26cc None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:03.551738 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78f862-e194-4afd-9897-deaf190b26cc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:03.552051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78f862-e194-4afd-9897-deaf190b26cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:03.553535 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78f862-e194-4afd-9897-deaf190b26cc None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:03.560930 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 337/667] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Aug 23 16:11:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:03.566880 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433baf10-076c-4d82-a7ec-b6964d9b09bf None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:03.664039 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:03.701197 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433baf10-076c-4d82-a7ec-b6964d9b09bf None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:03.743232 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ef7ad-c3a2-4926-b9b0-1ae6083133b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:03.743974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ef7ad-c3a2-4926-b9b0-1ae6083133b8 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:03.744246 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ef7ad-c3a2-4926-b9b0-1ae6083133b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:03.744515 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ef7ad-c3a2-4926-b9b0-1ae6083133b8 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:03.745380 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ef7ad-c3a2-4926-b9b0-1ae6083133b8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:03.745685 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ef7ad-c3a2-4926-b9b0-1ae6083133b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:03.747101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ef7ad-c3a2-4926-b9b0-1ae6083133b8 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:03.752636 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 331/668] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Aug 23 16:11:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:04.510214 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82d0f9-ea8c-4d20-abad-5f42c85b0392 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:04.511255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82d0f9-ea8c-4d20-abad-5f42c85b0392 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:04.511727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82d0f9-ea8c-4d20-abad-5f42c85b0392 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:04.513769 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 338/669] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:04.520335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35bf58-1a12-4592-866c-719ef30a7f25 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:04.521378 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35bf58-1a12-4592-866c-719ef30a7f25 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:04.521863 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35bf58-1a12-4592-866c-719ef30a7f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:04.543584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-2a35bf58-1a12-4592-866c-719ef30a7f25 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:04.545436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-2a35bf58-1a12-4592-866c-719ef30a7f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:04.646101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 332/670] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:04.988078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82d0f9-ea8c-4d20-abad-5f42c85b0392 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:05.118382 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82d0f9-ea8c-4d20-abad-5f42c85b0392 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:05.154873 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497df61-8158-4376-8b1e-8521f88d0280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:05.155525 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497df61-8158-4376-8b1e-8521f88d0280 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:05.155795 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497df61-8158-4376-8b1e-8521f88d0280 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:05.156064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497df61-8158-4376-8b1e-8521f88d0280 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:05.171432 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497df61-8158-4376-8b1e-8521f88d0280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-e497df61-8158-4376-8b1e-8521f88d0280 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:05.176951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:05.177943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:05.179201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 339/671] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:05.186644 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35bf58-1a12-4592-866c-719ef30a7f25 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:05.256966 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:05.303735 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35bf58-1a12-4592-866c-719ef30a7f25 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:05.343142 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3914ed3-2d15-45c8-9340-6a9da136a3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:05.343799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3914ed3-2d15-45c8-9340-6a9da136a3fe None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:05.344095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3914ed3-2d15-45c8-9340-6a9da136a3fe None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:05.344349 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3914ed3-2d15-45c8-9340-6a9da136a3fe None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:05.345021 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3914ed3-2d15-45c8-9340-6a9da136a3fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:05.345335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3914ed3-2d15-45c8-9340-6a9da136a3fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:05.346780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3914ed3-2d15-45c8-9340-6a9da136a3fe None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:05.357760 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 333/672] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:05.363687 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497df61-8158-4376-8b1e-8521f88d0280 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:05.435111 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:05.490458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497df61-8158-4376-8b1e-8521f88d0280 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:05.529932 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1044e-9e19-42af-a8ec-8fe759e6c40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:05.530600 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1044e-9e19-42af-a8ec-8fe759e6c40e None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:05.530834 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1044e-9e19-42af-a8ec-8fe759e6c40e None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:05.531051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1044e-9e19-42af-a8ec-8fe759e6c40e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:05.544054 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1044e-9e19-42af-a8ec-8fe759e6c40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:05.545524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1044e-9e19-42af-a8ec-8fe759e6c40e None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-7fb1044e-9e19-42af-a8ec-8fe759e6c40e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:11:05.571366 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:05.572388 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:11:05.573273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:11:05.573273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:05.573273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:05.573273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 340/673] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:05.578635 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3914ed3-2d15-45c8-9340-6a9da136a3fe None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:05.746860 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3914ed3-2d15-45c8-9340-6a9da136a3fe None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:05.801572 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:05.818929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f50afc-29b6-4636-9cbd-3b1a2aa56bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:05.819988 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f50afc-29b6-4636-9cbd-3b1a2aa56bac None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:05.820477 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f50afc-29b6-4636-9cbd-3b1a2aa56bac None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:05.820953 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f50afc-29b6-4636-9cbd-3b1a2aa56bac None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:05.822077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f50afc-29b6-4636-9cbd-3b1a2aa56bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:05.822579 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f50afc-29b6-4636-9cbd-3b1a2aa56bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:05.825162 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f50afc-29b6-4636-9cbd-3b1a2aa56bac None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:05.850275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 334/674] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:05.856511 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1044e-9e19-42af-a8ec-8fe759e6c40e None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:05.904717 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4386f-d503-4104-bb3e-e3896078b8ad None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:05.905062 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4386f-d503-4104-bb3e-e3896078b8ad None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:05.905271 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4386f-d503-4104-bb3e-e3896078b8ad None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:05.906865 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 335/675] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:05.913266 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e4a93-750c-41e4-a5d3-e0c6062a1cd4 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:05.913567 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e4a93-750c-41e4-a5d3-e0c6062a1cd4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:05.913809 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e4a93-750c-41e4-a5d3-e0c6062a1cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:05.933279 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b79e4a93-750c-41e4-a5d3-e0c6062a1cd4 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:05.934542 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b79e4a93-750c-41e4-a5d3-e0c6062a1cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:05.988513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1044e-9e19-42af-a8ec-8fe759e6c40e None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:05.991612 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:06.014829 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 336/676] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:06.019528 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743888a4-b2a7-4cf6-930e-5d417cedf60c None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.020927 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743888a4-b2a7-4cf6-930e-5d417cedf60c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.021576 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743888a4-b2a7-4cf6-930e-5d417cedf60c None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.026318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 337/677] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:06.032508 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd810da-b0dc-405f-a3f0-34dc8b6bf4a3 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.033262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd810da-b0dc-405f-a3f0-34dc8b6bf4a3 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.034129 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd810da-b0dc-405f-a3f0-34dc8b6bf4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.042328 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c31bb-8b7d-4f47-b7e5-1fc38f46f5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:06.044047 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c31bb-8b7d-4f47-b7e5-1fc38f46f5fa None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.044348 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c31bb-8b7d-4f47-b7e5-1fc38f46f5fa None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.044626 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c31bb-8b7d-4f47-b7e5-1fc38f46f5fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.054574 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c31bb-8b7d-4f47-b7e5-1fc38f46f5fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:06.056100 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c31bb-8b7d-4f47-b7e5-1fc38f46f5fa None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:06.056468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-0fd810da-b0dc-405f-a3f0-34dc8b6bf4a3 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:06.057885 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-0fd810da-b0dc-405f-a3f0-34dc8b6bf4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-6d3c31bb-8b7d-4f47-b7e5-1fc38f46f5fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:11:06.070273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:06.071324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:06.072268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:06.072268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:06.072268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:11:06.072268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:11:06.072268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:11:06.072268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:11:06.072268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:11:06.072268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:11:06.072268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:11:06.072268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:06.079586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 341/678] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 23 16:11:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:06.081209 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c31bb-8b7d-4f47-b7e5-1fc38f46f5fa None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:06.150534 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 338/679] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:06.188361 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40d772-b34c-48fe-af48-b3a624a5023a None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.188692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40d772-b34c-48fe-af48-b3a624a5023a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.188908 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40d772-b34c-48fe-af48-b3a624a5023a None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.194049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 339/680] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:06.196451 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6924f85-cab5-4e6e-be80-1720a0c0566b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.196779 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6924f85-cab5-4e6e-be80-1720a0c0566b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.197048 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6924f85-cab5-4e6e-be80-1720a0c0566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.211582 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c31bb-8b7d-4f47-b7e5-1fc38f46f5fa None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:06.216624 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a6924f85-cab5-4e6e-be80-1720a0c0566b None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:06.217842 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a6924f85-cab5-4e6e-be80-1720a0c0566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:06.251788 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df84d3-f572-4a3e-97bf-23e70f77c2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:06.252594 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df84d3-f572-4a3e-97bf-23e70f77c2da None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.252963 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df84d3-f572-4a3e-97bf-23e70f77c2da None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.253384 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df84d3-f572-4a3e-97bf-23e70f77c2da None admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.254252 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df84d3-f572-4a3e-97bf-23e70f77c2da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:06.254645 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df84d3-f572-4a3e-97bf-23e70f77c2da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:06.256182 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df84d3-f572-4a3e-97bf-23e70f77c2da None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:06.272132 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:06.282074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 342/681] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 23 16:11:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:06.283846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df84d3-f572-4a3e-97bf-23e70f77c2da None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:06.308116 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 340/682] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:06.379641 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:06.394800 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df84d3-f572-4a3e-97bf-23e70f77c2da None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:06.395983 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6924f85-cab5-4e6e-be80-1720a0c0566b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:06.435780 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7caced-fe0d-4cfa-b5c6-65e782894bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:06.436775 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7caced-fe0d-4cfa-b5c6-65e782894bb8 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.437209 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7caced-fe0d-4cfa-b5c6-65e782894bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.437623 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7caced-fe0d-4cfa-b5c6-65e782894bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.452887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7caced-fe0d-4cfa-b5c6-65e782894bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:06.454706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7caced-fe0d-4cfa-b5c6-65e782894bb8 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-fb7caced-fe0d-4cfa-b5c6-65e782894bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:11:06.472097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:06.473320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:11:06.474336 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:11:06.474336 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:06.474336 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:06.476399 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 343/683] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:06.482531 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7caced-fe0d-4cfa-b5c6-65e782894bb8 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:06.513179 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6924f85-cab5-4e6e-be80-1720a0c0566b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:06.551691 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dff44-cd62-45c5-9b5a-a3fa4a102763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:06.552305 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dff44-cd62-45c5-9b5a-a3fa4a102763 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.552675 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dff44-cd62-45c5-9b5a-a3fa4a102763 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.552954 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dff44-cd62-45c5-9b5a-a3fa4a102763 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.553618 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dff44-cd62-45c5-9b5a-a3fa4a102763 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:06.555244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dff44-cd62-45c5-9b5a-a3fa4a102763 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:06.574240 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 341/684] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 23 16:11:06 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:11:06.575104 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dff44-cd62-45c5-9b5a-a3fa4a102763 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:06.618386 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:06.619421 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:06.633832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7caced-fe0d-4cfa-b5c6-65e782894bb8 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:06.692428 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4409-2d32-421c-8a9e-43c2187f265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:06.693081 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4409-2d32-421c-8a9e-43c2187f265e None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.693353 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4409-2d32-421c-8a9e-43c2187f265e None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.693626 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4409-2d32-421c-8a9e-43c2187f265e None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.694359 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f4409-2d32-421c-8a9e-43c2187f265e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:06.694661 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f4409-2d32-421c-8a9e-43c2187f265e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:06.696218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f4409-2d32-421c-8a9e-43c2187f265e None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:06.701937 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dff44-cd62-45c5-9b5a-a3fa4a102763 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:06.709517 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 344/685] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:06.711547 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4409-2d32-421c-8a9e-43c2187f265e None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:06.745726 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291090e-2058-4986-82d1-1df10d44f47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:06.746428 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291090e-2058-4986-82d1-1df10d44f47a None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.746719 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291090e-2058-4986-82d1-1df10d44f47a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.747005 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291090e-2058-4986-82d1-1df10d44f47a None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.747917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291090e-2058-4986-82d1-1df10d44f47a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:06.750172 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291090e-2058-4986-82d1-1df10d44f47a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:06.778250 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 342/686] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 23 16:11:06 2022] POST /identity/v3/services => generated 240 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:06.778250 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291090e-2058-4986-82d1-1df10d44f47a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:06.847687 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4409-2d32-421c-8a9e-43c2187f265e None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:06.890375 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:06.903138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bf00f-3508-43bb-803b-d9eb8ab1c3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:06.904345 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bf00f-3508-43bb-803b-d9eb8ab1c3f1 None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.905492 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bf00f-3508-43bb-803b-d9eb8ab1c3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.906035 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bf00f-3508-43bb-803b-d9eb8ab1c3f1 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.907226 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bf00f-3508-43bb-803b-d9eb8ab1c3f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:06.909817 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bf00f-3508-43bb-803b-d9eb8ab1c3f1 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:06.912635 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:06.923141 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291090e-2058-4986-82d1-1df10d44f47a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:06.935829 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 345/687] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 23 16:11:06 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:06.988239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f3eba-912c-49d9-a8f3-09ffe3814f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:06.988893 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f3eba-912c-49d9-a8f3-09ffe3814f94 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.989234 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f3eba-912c-49d9-a8f3-09ffe3814f94 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.989512 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f3eba-912c-49d9-a8f3-09ffe3814f94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.997925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f3eba-912c-49d9-a8f3-09ffe3814f94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:06.999534 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f3eba-912c-49d9-a8f3-09ffe3814f94 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-7f9f3eba-912c-49d9-a8f3-09ffe3814f94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:11:07.012946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:07.013942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:07.014976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:11:07.014976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:11:07.014976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:11:07.014976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:11:07.014976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:11:07.014976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:11:07.014976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:11:07.014976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:07.014976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 343/688] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:07.022105 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bf00f-3508-43bb-803b-d9eb8ab1c3f1 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:07.155500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bf00f-3508-43bb-803b-d9eb8ab1c3f1 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:07.194270 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22571235-309b-4371-b723-68533b038f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:07.195001 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22571235-309b-4371-b723-68533b038f49 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:07.195445 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22571235-309b-4371-b723-68533b038f49 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:07.195896 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22571235-309b-4371-b723-68533b038f49 None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:07.196602 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22571235-309b-4371-b723-68533b038f49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:07.196906 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22571235-309b-4371-b723-68533b038f49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:07.198372 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22571235-309b-4371-b723-68533b038f49 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:07.212260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 346/689] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:11:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:07.218175 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f3eba-912c-49d9-a8f3-09ffe3814f94 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:07.333707 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f3eba-912c-49d9-a8f3-09ffe3814f94 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:07.372359 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2d65c-3e7f-4fe6-96ed-9d2bc784e0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:07.373407 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2d65c-3e7f-4fe6-96ed-9d2bc784e0dc None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:07.373875 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2d65c-3e7f-4fe6-96ed-9d2bc784e0dc None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:07.374438 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2d65c-3e7f-4fe6-96ed-9d2bc784e0dc None admin] PATH_INFO: `/v3/projects/ce23217f97fd4906afea681353330615/users/9c6749b0664141529ce43b78fbc836ee/roles/5756384fa8d842139e2f1fc44c5088bd` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:07.376643 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2d65c-3e7f-4fe6-96ed-9d2bc784e0dc None admin] RBAC: Authorizing `identity:create_grant(project_id=ce23217f97fd4906afea681353330615, user_id=9c6749b0664141529ce43b78fbc836ee, role_id=5756384fa8d842139e2f1fc44c5088bd)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:07.378324 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2d65c-3e7f-4fe6-96ed-9d2bc784e0dc None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:07.395250 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 344/690] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:11:07 2022] PUT /identity/v3/projects/ce23217f97fd4906afea681353330615/users/9c6749b0664141529ce43b78fbc836ee/roles/5756384fa8d842139e2f1fc44c5088bd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:11:09.100955 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84b9b2-c6a1-42c4-9e93-8db2fb4e884e None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.101516 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84b9b2-c6a1-42c4-9e93-8db2fb4e884e None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.101516 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84b9b2-c6a1-42c4-9e93-8db2fb4e884e None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.103285 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 347/691] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:09.108975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d3567-e64f-4192-9833-2e6314513e00 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.109443 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d3567-e64f-4192-9833-2e6314513e00 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.109521 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d3567-e64f-4192-9833-2e6314513e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.128880 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-430d3567-e64f-4192-9833-2e6314513e00 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:09.130189 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-430d3567-e64f-4192-9833-2e6314513e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:09.130648 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cab21-03e8-4d06-a6f8-10bdd53da98d None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.130937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cab21-03e8-4d06-a6f8-10bdd53da98d None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.131208 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cab21-03e8-4d06-a6f8-10bdd53da98d None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.132575 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 348/692] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:09.138390 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe683430-f25a-4fd2-96b6-d43027dc4a93 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.138701 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe683430-f25a-4fd2-96b6-d43027dc4a93 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.138928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe683430-f25a-4fd2-96b6-d43027dc4a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.142114 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:09.161092 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-fe683430-f25a-4fd2-96b6-d43027dc4a93 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:09.162744 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-fe683430-f25a-4fd2-96b6-d43027dc4a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:09.221083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 345/693] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:09 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:09.230737 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:09.253034 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 349/694] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:09 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:11:09.335113 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18547d-0116-495c-b0a8-872ce6e04665 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.335751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18547d-0116-495c-b0a8-872ce6e04665 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.336225 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18547d-0116-495c-b0a8-872ce6e04665 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.338138 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 346/695] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:09.343416 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c0b75-68e7-483b-b55a-dc43a65c8347 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.346031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c0b75-68e7-483b-b55a-dc43a65c8347 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.346031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c0b75-68e7-483b-b55a-dc43a65c8347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.363735 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-432c0b75-68e7-483b-b55a-dc43a65c8347 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:09.365659 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-432c0b75-68e7-483b-b55a-dc43a65c8347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:09.462141 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 350/696] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:09 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:09.582212 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18547d-0116-495c-b0a8-872ce6e04665 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:09.646485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c0b75-68e7-483b-b55a-dc43a65c8347 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:09.717576 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18547d-0116-495c-b0a8-872ce6e04665 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:09.767213 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73414b79-e86d-46c4-9742-bd8242fb6426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:09.768097 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73414b79-e86d-46c4-9742-bd8242fb6426 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.768425 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73414b79-e86d-46c4-9742-bd8242fb6426 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.768729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73414b79-e86d-46c4-9742-bd8242fb6426 None admin] PATH_INFO: `/v3/services/image` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.769552 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73414b79-e86d-46c4-9742-bd8242fb6426 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:09.771571 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73414b79-e86d-46c4-9742-bd8242fb6426 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-73414b79-e86d-46c4-9742-bd8242fb6426 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:09.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:09.785423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:09.787157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 347/697] 10.222.0.47 () {56 vars in 1105 bytes} [Tue Aug 23 16:11:09 2022] GET /identity/v3/services/image => generated 86 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:09.790603 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73414b79-e86d-46c4-9742-bd8242fb6426 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:09.804204 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c0b75-68e7-483b-b55a-dc43a65c8347 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:09.806204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:09.818358 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:09.851422 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7524-d496-466d-af63-b876e503810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:09.852587 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7524-d496-466d-af63-b876e503810b None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.852900 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7524-d496-466d-af63-b876e503810b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.853141 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7524-d496-466d-af63-b876e503810b None admin] PATH_INFO: `/v3/services/network` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.853733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7524-d496-466d-af63-b876e503810b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:09.855179 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7524-d496-466d-af63-b876e503810b None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-277b7524-d496-466d-af63-b876e503810b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:09.876479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:09.877546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:11:09.878468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:09.879219 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 351/698] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:09 2022] GET /identity/v3/services/network => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:09.880339 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7524-d496-466d-af63-b876e503810b None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:09.943991 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73414b79-e86d-46c4-9742-bd8242fb6426 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:09.988696 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff3cd3-4b51-4f5c-8515-0b09f192a153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:09.989346 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff3cd3-4b51-4f5c-8515-0b09f192a153 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.989622 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff3cd3-4b51-4f5c-8515-0b09f192a153 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.989887 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff3cd3-4b51-4f5c-8515-0b09f192a153 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.990487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff3cd3-4b51-4f5c-8515-0b09f192a153 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:09.992028 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff3cd3-4b51-4f5c-8515-0b09f192a153 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-21ff3cd3-4b51-4f5c-8515-0b09f192a153 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:10.001556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:10.002896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:10.003928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 348/699] 10.222.0.47 () {56 vars in 1129 bytes} [Tue Aug 23 16:11:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:10.006553 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff3cd3-4b51-4f5c-8515-0b09f192a153 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:10.012927 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7524-d496-466d-af63-b876e503810b None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:10.052802 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c810dc3-9128-4f7e-8453-c5a80b817792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:10.053436 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c810dc3-9128-4f7e-8453-c5a80b817792 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:10.053713 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c810dc3-9128-4f7e-8453-c5a80b817792 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:10.053987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c810dc3-9128-4f7e-8453-c5a80b817792 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:10.054822 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c810dc3-9128-4f7e-8453-c5a80b817792 None admin] RBAC: Adding query filter params (name=image) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:10.055513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c810dc3-9128-4f7e-8453-c5a80b817792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:10.056777 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c810dc3-9128-4f7e-8453-c5a80b817792 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:10.063295 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 352/700] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:10.064201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf87db8-5201-419b-8a3b-8b721efb427d None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:10.065355 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf87db8-5201-419b-8a3b-8b721efb427d None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:10.065355 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf87db8-5201-419b-8a3b-8b721efb427d None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:10.065805 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 353/701] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:10.071133 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf87db8-5201-419b-8a3b-8b721efb427d None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:10.106172 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:10.111223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:10.143352 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff3cd3-4b51-4f5c-8515-0b09f192a153 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:10.185817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c3c2d-b353-4618-9c48-4410b70e87a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:10.186602 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c3c2d-b353-4618-9c48-4410b70e87a0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:10.186877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c3c2d-b353-4618-9c48-4410b70e87a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:10.187153 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c3c2d-b353-4618-9c48-4410b70e87a0 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:10.188016 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c3c2d-b353-4618-9c48-4410b70e87a0 None admin] RBAC: Adding query filter params (name=network) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:10.188336 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c3c2d-b353-4618-9c48-4410b70e87a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:10.189829 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c3c2d-b353-4618-9c48-4410b70e87a0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:10.195882 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 349/702] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:10.196461 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c3c2d-b353-4618-9c48-4410b70e87a0 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:10.312839 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c3c2d-b353-4618-9c48-4410b70e87a0 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:10.313211 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf87db8-5201-419b-8a3b-8b721efb427d None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:10.349303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58c1eb-fb51-4423-bf8e-6572967d9635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:10.349941 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58c1eb-fb51-4423-bf8e-6572967d9635 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:10.350241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58c1eb-fb51-4423-bf8e-6572967d9635 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:10.350515 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58c1eb-fb51-4423-bf8e-6572967d9635 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:10.350934 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc7b57-bed0-425f-9a20-149b667cbf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:10.351147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58c1eb-fb51-4423-bf8e-6572967d9635 None admin] RBAC: Adding query filter params (type=image) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:10.351446 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58c1eb-fb51-4423-bf8e-6572967d9635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:10.351536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc7b57-bed0-425f-9a20-149b667cbf9c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:10.351823 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc7b57-bed0-425f-9a20-149b667cbf9c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:10.352117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc7b57-bed0-425f-9a20-149b667cbf9c None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:10.352750 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc7b57-bed0-425f-9a20-149b667cbf9c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:10.352878 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58c1eb-fb51-4423-bf8e-6572967d9635 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:10.353074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc7b57-bed0-425f-9a20-149b667cbf9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:10.354400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:10.354529 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc7b57-bed0-425f-9a20-149b667cbf9c None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:10.359270 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 350/703] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:10.360024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 354/704] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Aug 23 16:11:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:10.360889 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc7b57-bed0-425f-9a20-149b667cbf9c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:10.366356 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64424083-3fac-4205-b61c-fcb993c767e7 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:10.366806 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64424083-3fac-4205-b61c-fcb993c767e7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:10.368488 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64424083-3fac-4205-b61c-fcb993c767e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:10.388115 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-64424083-3fac-4205-b61c-fcb993c767e7 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:10.389354 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-64424083-3fac-4205-b61c-fcb993c767e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:10.463912 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 351/705] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:10.464695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64424083-3fac-4205-b61c-fcb993c767e7 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:10.478131 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc7b57-bed0-425f-9a20-149b667cbf9c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:10.479910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:10.525359 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62410a75-427c-4300-bb3f-aaf10ac8c150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:10.526267 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62410a75-427c-4300-bb3f-aaf10ac8c150 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:10.526738 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62410a75-427c-4300-bb3f-aaf10ac8c150 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:10.527410 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62410a75-427c-4300-bb3f-aaf10ac8c150 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:10.528600 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62410a75-427c-4300-bb3f-aaf10ac8c150 None admin] RBAC: Adding query filter params (type=network) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:10.529260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62410a75-427c-4300-bb3f-aaf10ac8c150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:10.531590 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62410a75-427c-4300-bb3f-aaf10ac8c150 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:10.538173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 355/706] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:10.539700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62410a75-427c-4300-bb3f-aaf10ac8c150 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:10.612659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64424083-3fac-4205-b61c-fcb993c767e7 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:10.643107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:10.653105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12472a95-562b-4ff4-af87-ca30f7e41f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:10.653838 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12472a95-562b-4ff4-af87-ca30f7e41f98 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:10.653969 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62410a75-427c-4300-bb3f-aaf10ac8c150 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:10.654225 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12472a95-562b-4ff4-af87-ca30f7e41f98 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:10.654561 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12472a95-562b-4ff4-af87-ca30f7e41f98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:10.655351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12472a95-562b-4ff4-af87-ca30f7e41f98 None admin] RBAC: Adding query filter params (interface=public, service_id=6f1020334a474a7e9c8925c395177d63, region_id=RegionOne) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:10.655721 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12472a95-562b-4ff4-af87-ca30f7e41f98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:10.657180 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12472a95-562b-4ff4-af87-ca30f7e41f98 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:10.666963 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 352/707] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 23 16:11:10 2022] GET /identity/v3/endpoints?service_id=6f1020334a474a7e9c8925c395177d63&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:10.668062 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12472a95-562b-4ff4-af87-ca30f7e41f98 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:10.700725 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a938f7-cdf0-4fa0-8e5e-bd83516e98ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:10.701365 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a938f7-cdf0-4fa0-8e5e-bd83516e98ad None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:10.701768 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a938f7-cdf0-4fa0-8e5e-bd83516e98ad None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:10.701877 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a938f7-cdf0-4fa0-8e5e-bd83516e98ad None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:10.702592 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a938f7-cdf0-4fa0-8e5e-bd83516e98ad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:10.702895 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a938f7-cdf0-4fa0-8e5e-bd83516e98ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:10.704325 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a938f7-cdf0-4fa0-8e5e-bd83516e98ad None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:10.714143 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 356/708] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Aug 23 16:11:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:10.714143 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a938f7-cdf0-4fa0-8e5e-bd83516e98ad None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:10.744741 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:10.800812 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12472a95-562b-4ff4-af87-ca30f7e41f98 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:10.833042 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a938f7-cdf0-4fa0-8e5e-bd83516e98ad None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:10.844670 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3762d-25d3-4625-865c-b87b6230bf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:10.845340 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3762d-25d3-4625-865c-b87b6230bf5a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:10.845645 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3762d-25d3-4625-865c-b87b6230bf5a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:10.845954 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3762d-25d3-4625-865c-b87b6230bf5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:10.846761 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3762d-25d3-4625-865c-b87b6230bf5a None admin] RBAC: Adding query filter params (interface=public, service_id=a0e1169a44eb4e62a821dcbef766f911, region_id=RegionOne) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:10.847064 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3762d-25d3-4625-865c-b87b6230bf5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:10.848656 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3762d-25d3-4625-865c-b87b6230bf5a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:10.855308 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 353/709] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 23 16:11:10 2022] GET /identity/v3/endpoints?service_id=a0e1169a44eb4e62a821dcbef766f911&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:10.856191 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3762d-25d3-4625-865c-b87b6230bf5a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:10.872669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c5981-7108-4c10-90ca-e3577c05cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:10.873246 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c5981-7108-4c10-90ca-e3577c05cfff None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:10.873518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c5981-7108-4c10-90ca-e3577c05cfff None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:10.873782 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c5981-7108-4c10-90ca-e3577c05cfff None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:10.874432 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c5981-7108-4c10-90ca-e3577c05cfff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:10.875784 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c5981-7108-4c10-90ca-e3577c05cfff None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:10.881051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 357/710] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 23 16:11:10 2022] GET /identity/v3/services => generated 1002 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:11:10.881880 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c5981-7108-4c10-90ca-e3577c05cfff None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:10.922096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:10.976184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3762d-25d3-4625-865c-b87b6230bf5a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:11.025191 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5a039-59a7-4b6f-9274-cb177f0d444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:11.026149 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5a039-59a7-4b6f-9274-cb177f0d444e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:11.026428 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5a039-59a7-4b6f-9274-cb177f0d444e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:11.026702 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5a039-59a7-4b6f-9274-cb177f0d444e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:11.027429 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5a039-59a7-4b6f-9274-cb177f0d444e None admin] RBAC: Adding query filter params (interface=public, service_id=5d585c62d8fe45e5a84e670cd2d307ed, region_id=RegionOne) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:11.027738 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5a039-59a7-4b6f-9274-cb177f0d444e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:11.028701 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:11.029160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5a039-59a7-4b6f-9274-cb177f0d444e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:11.036222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 354/711] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 23 16:11:10 2022] GET /identity/v3/endpoints?service_id=5d585c62d8fe45e5a84e670cd2d307ed&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:11.037083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5a039-59a7-4b6f-9274-cb177f0d444e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:11.046586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c5981-7108-4c10-90ca-e3577c05cfff None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:11.098487 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27ba91-0012-4747-a33f-0ca71aacaae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:11.099133 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ba91-0012-4747-a33f-0ca71aacaae6 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:11.099435 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ba91-0012-4747-a33f-0ca71aacaae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:11.099676 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ba91-0012-4747-a33f-0ca71aacaae6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:11.116658 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27ba91-0012-4747-a33f-0ca71aacaae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-2a27ba91-0012-4747-a33f-0ca71aacaae6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:11.121632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:11.122656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:11.123579 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 358/712] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:11:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:11.124310 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27ba91-0012-4747-a33f-0ca71aacaae6 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:11.165564 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5a039-59a7-4b6f-9274-cb177f0d444e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:11.191475 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:11.209935 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170bc2b-8841-44d0-87bc-7e8fde6df445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:11.210681 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170bc2b-8841-44d0-87bc-7e8fde6df445 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:11.211002 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170bc2b-8841-44d0-87bc-7e8fde6df445 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:11.211276 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170bc2b-8841-44d0-87bc-7e8fde6df445 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:11.212131 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170bc2b-8841-44d0-87bc-7e8fde6df445 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:11.213605 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170bc2b-8841-44d0-87bc-7e8fde6df445 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:11.230116 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 355/713] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 23 16:11:11 2022] GET /identity/v3/services => generated 1002 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:11:11.230116 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170bc2b-8841-44d0-87bc-7e8fde6df445 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:11.250053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27ba91-0012-4747-a33f-0ca71aacaae6 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:11.291583 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3671d9-5f9a-4086-9ba7-9e04508b7b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:11.292430 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3671d9-5f9a-4086-9ba7-9e04508b7b89 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:11.292817 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3671d9-5f9a-4086-9ba7-9e04508b7b89 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:11.293173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3671d9-5f9a-4086-9ba7-9e04508b7b89 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:11.293842 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3671d9-5f9a-4086-9ba7-9e04508b7b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:11.295509 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3671d9-5f9a-4086-9ba7-9e04508b7b89 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:11.302926 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 359/714] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 23 16:11:11 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:11:11.364910 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170bc2b-8841-44d0-87bc-7e8fde6df445 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:11.412766 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8e744-a7ba-47ab-a3c8-b0edb3dcf3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:11.413475 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8e744-a7ba-47ab-a3c8-b0edb3dcf3b4 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:11.413755 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8e744-a7ba-47ab-a3c8-b0edb3dcf3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:11.414125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8e744-a7ba-47ab-a3c8-b0edb3dcf3b4 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:11.414888 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8e744-a7ba-47ab-a3c8-b0edb3dcf3b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:11.415192 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8e744-a7ba-47ab-a3c8-b0edb3dcf3b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:11.416714 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8e744-a7ba-47ab-a3c8-b0edb3dcf3b4 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:11.427647 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 356/715] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:11.434369 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3671d9-5f9a-4086-9ba7-9e04508b7b89 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:11.453682 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:11.565052 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3671d9-5f9a-4086-9ba7-9e04508b7b89 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:11.602515 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c67e9-3358-4eb8-8a30-259f0f418051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:11.603253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c67e9-3358-4eb8-8a30-259f0f418051 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:11.603531 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c67e9-3358-4eb8-8a30-259f0f418051 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:11.603804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c67e9-3358-4eb8-8a30-259f0f418051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:11.617489 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c67e9-3358-4eb8-8a30-259f0f418051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:11.619087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c67e9-3358-4eb8-8a30-259f0f418051 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-014c67e9-3358-4eb8-8a30-259f0f418051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:11:11.635123 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:11.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:11:11.637105 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:11:11.637105 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:11.637105 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:11.637105 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 360/716] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:11.643393 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8e744-a7ba-47ab-a3c8-b0edb3dcf3b4 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:11.696104 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:11.756038 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8e744-a7ba-47ab-a3c8-b0edb3dcf3b4 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:11.798216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a84db9-d372-4310-a163-1f08f38421c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:11.798846 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a84db9-d372-4310-a163-1f08f38421c2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:11.799125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a84db9-d372-4310-a163-1f08f38421c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:11.799396 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a84db9-d372-4310-a163-1f08f38421c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:11.800042 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a84db9-d372-4310-a163-1f08f38421c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:11.800342 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a84db9-d372-4310-a163-1f08f38421c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:11.801734 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a84db9-d372-4310-a163-1f08f38421c2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:11.815232 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 357/717] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:11.820669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c67e9-3358-4eb8-8a30-259f0f418051 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:11.916070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:11.952492 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c67e9-3358-4eb8-8a30-259f0f418051 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:11.989444 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79b8bd-0197-4436-9bd3-c4142b30c86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:11.990556 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79b8bd-0197-4436-9bd3-c4142b30c86c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:11.991039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79b8bd-0197-4436-9bd3-c4142b30c86c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:11.991501 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79b8bd-0197-4436-9bd3-c4142b30c86c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.002053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79b8bd-0197-4436-9bd3-c4142b30c86c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:12.004218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79b8bd-0197-4436-9bd3-c4142b30c86c None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-5a79b8bd-0197-4436-9bd3-c4142b30c86c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:11:12.020460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:12.021920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:12.023290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:12.023290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:12.023290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:11:12.023290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:11:12.023290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:11:12.023290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:11:12.023290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:11:12.023290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:11:12.023290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:11:12.023290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:12.026791 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 361/718] 10.222.0.47 () {56 vars in 1093 bytes} [Tue Aug 23 16:11:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:12.033631 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a84db9-d372-4310-a163-1f08f38421c2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:12.164997 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a84db9-d372-4310-a163-1f08f38421c2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:12.174373 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:12.213408 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b20aa-b699-4283-aaad-7561bbe647aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:12.214107 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b20aa-b699-4283-aaad-7561bbe647aa None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.214389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b20aa-b699-4283-aaad-7561bbe647aa None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.214662 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b20aa-b699-4283-aaad-7561bbe647aa None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.215454 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b20aa-b699-4283-aaad-7561bbe647aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:12.215762 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b20aa-b699-4283-aaad-7561bbe647aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:12.217482 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b20aa-b699-4283-aaad-7561bbe647aa None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:12.243756 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 358/719] 10.222.0.47 () {56 vars in 1133 bytes} [Tue Aug 23 16:11:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:12.249427 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79b8bd-0197-4436-9bd3-c4142b30c86c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:12.362851 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79b8bd-0197-4436-9bd3-c4142b30c86c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:12.390872 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:12.400131 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0e885-cb40-47b4-8154-d56b47b8b5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:12.401232 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0e885-cb40-47b4-8154-d56b47b8b5ec None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.402019 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0e885-cb40-47b4-8154-d56b47b8b5ec None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.402293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0e885-cb40-47b4-8154-d56b47b8b5ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.474894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0e885-cb40-47b4-8154-d56b47b8b5ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:12.476681 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0e885-cb40-47b4-8154-d56b47b8b5ec None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:12.590966 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 362/720] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:12 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:11:12.596934 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b20aa-b699-4283-aaad-7561bbe647aa None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:12.719558 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b20aa-b699-4283-aaad-7561bbe647aa None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:12.778463 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78de83f-8187-466e-80ec-848c964982f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:12.779134 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78de83f-8187-466e-80ec-848c964982f0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.779408 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78de83f-8187-466e-80ec-848c964982f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.779674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78de83f-8187-466e-80ec-848c964982f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.791173 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78de83f-8187-466e-80ec-848c964982f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:12.792723 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78de83f-8187-466e-80ec-848c964982f0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-f78de83f-8187-466e-80ec-848c964982f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:11:12.809125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:12.810316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:11:12.811226 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:11:12.811226 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:12.811226 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:12.811226 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 359/721] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:12.817753 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0e885-cb40-47b4-8154-d56b47b8b5ec None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:12.854988 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:12.928015 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0e885-cb40-47b4-8154-d56b47b8b5ec None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:12.971077 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59771464-c325-4bb9-881d-c1b0a0c4eb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:12.972537 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59771464-c325-4bb9-881d-c1b0a0c4eb48 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.973244 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59771464-c325-4bb9-881d-c1b0a0c4eb48 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.973962 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59771464-c325-4bb9-881d-c1b0a0c4eb48 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.975216 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59771464-c325-4bb9-881d-c1b0a0c4eb48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:12.975888 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59771464-c325-4bb9-881d-c1b0a0c4eb48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:12.978825 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59771464-c325-4bb9-881d-c1b0a0c4eb48 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:12.999446 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 363/722] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:13.006827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78de83f-8187-466e-80ec-848c964982f0 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:13.033875 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:13.134431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78de83f-8187-466e-80ec-848c964982f0 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:13.173148 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03cf1a-2534-4c6e-a921-e729a933d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:13.173787 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cf1a-2534-4c6e-a921-e729a933d740 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.174087 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cf1a-2534-4c6e-a921-e729a933d740 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.174353 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cf1a-2534-4c6e-a921-e729a933d740 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.182036 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03cf1a-2534-4c6e-a921-e729a933d740 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:13.184619 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03cf1a-2534-4c6e-a921-e729a933d740 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-0c03cf1a-2534-4c6e-a921-e729a933d740 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:11:13.198674 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:13.199686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:13.200584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:11:13.200584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:11:13.200584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:11:13.200584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:11:13.200584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:11:13.200584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:11:13.200584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:11:13.200584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:13.200584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 360/723] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:13.207713 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59771464-c325-4bb9-881d-c1b0a0c4eb48 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:13.303221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:13.332764 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59771464-c325-4bb9-881d-c1b0a0c4eb48 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:13.395545 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cd35f-7774-49f4-ba54-e6fe0c0357d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:13.396597 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cd35f-7774-49f4-ba54-e6fe0c0357d2 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.397067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cd35f-7774-49f4-ba54-e6fe0c0357d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.397800 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cd35f-7774-49f4-ba54-e6fe0c0357d2 None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.399450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cd35f-7774-49f4-ba54-e6fe0c0357d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:13.400263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cd35f-7774-49f4-ba54-e6fe0c0357d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:13.403129 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cd35f-7774-49f4-ba54-e6fe0c0357d2 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:13.425890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 364/724] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:11:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:13.434617 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03cf1a-2534-4c6e-a921-e729a933d740 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:13.535096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10aab8-d103-4766-b019-dba14561dba5 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.535756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10aab8-d103-4766-b019-dba14561dba5 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.536133 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:13.536424 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10aab8-d103-4766-b019-dba14561dba5 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.539924 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 365/725] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:13.545647 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0922ed-2536-4fc9-826f-cff081ba3ca7 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.545923 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0922ed-2536-4fc9-826f-cff081ba3ca7 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.546228 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0922ed-2536-4fc9-826f-cff081ba3ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.571295 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-6e0922ed-2536-4fc9-826f-cff081ba3ca7 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:13.572881 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-6e0922ed-2536-4fc9-826f-cff081ba3ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:13.573452 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03cf1a-2534-4c6e-a921-e729a933d740 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:13.610300 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeab9a-e583-4b0b-b7a7-7dab82f04983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:13.610891 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeab9a-e583-4b0b-b7a7-7dab82f04983 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.611165 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeab9a-e583-4b0b-b7a7-7dab82f04983 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.611500 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeab9a-e583-4b0b-b7a7-7dab82f04983 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.612229 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeab9a-e583-4b0b-b7a7-7dab82f04983 None admin] RBAC: Adding query filter params (role.id=5756384fa8d842139e2f1fc44c5088bd, scope.project.id=ce23217f97fd4906afea681353330615, user.id=9c6749b0664141529ce43b78fbc836ee) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:13.612577 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeab9a-e583-4b0b-b7a7-7dab82f04983 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:13.614031 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeab9a-e583-4b0b-b7a7-7dab82f04983 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:13.621455 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 361/726] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:13 2022] GET /identity/v3/role_assignments?user.id=9c6749b0664141529ce43b78fbc836ee&scope.project.id=ce23217f97fd4906afea681353330615&role.id=5756384fa8d842139e2f1fc44c5088bd => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:13.641797 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d09b-a81a-4394-a75b-86156dc374d2 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.642160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d09b-a81a-4394-a75b-86156dc374d2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.642359 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d09b-a81a-4394-a75b-86156dc374d2 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.644268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 362/727] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:13.650967 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa6488-30a0-465f-802a-3caf0158f9d4 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.651331 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa6488-30a0-465f-802a-3caf0158f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.651667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa6488-30a0-465f-802a-3caf0158f9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.657932 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 366/728] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:13.676635 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-4afa6488-30a0-465f-802a-3caf0158f9d4 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:13.677855 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-4afa6488-30a0-465f-802a-3caf0158f9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:13.761416 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 363/729] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:11:13.904043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7a5a4-0c59-4177-8b14-f17e1c7d1e60 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.904349 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7a5a4-0c59-4177-8b14-f17e1c7d1e60 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.904546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7a5a4-0c59-4177-8b14-f17e1c7d1e60 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.906090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 367/730] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:13.915692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958583da-709a-4f27-ba85-903397e277c9 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.916050 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958583da-709a-4f27-ba85-903397e277c9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.916350 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958583da-709a-4f27-ba85-903397e277c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.935419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-958583da-709a-4f27-ba85-903397e277c9 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:13.936616 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-958583da-709a-4f27-ba85-903397e277c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:13.992146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7a5a4-0c59-4177-8b14-f17e1c7d1e60 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.009480 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:14.014725 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 364/731] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:14.078911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:14.104144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7a5a4-0c59-4177-8b14-f17e1c7d1e60 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.117542 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958583da-709a-4f27-ba85-903397e277c9 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.140244 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f67d13-d396-46f1-858f-d198b3254853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.140906 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f67d13-d396-46f1-858f-d198b3254853 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.141204 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f67d13-d396-46f1-858f-d198b3254853 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.141472 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f67d13-d396-46f1-858f-d198b3254853 None admin] PATH_INFO: `/v3/services/image` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.142102 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f67d13-d396-46f1-858f-d198b3254853 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.143595 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f67d13-d396-46f1-858f-d198b3254853 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-f8f67d13-d396-46f1-858f-d198b3254853 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:14.153957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:14.155684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:11:14.157298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:14.160866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 368/732] 10.222.0.47 () {56 vars in 1105 bytes} [Tue Aug 23 16:11:13 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:14.162249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f67d13-d396-46f1-858f-d198b3254853 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.241703 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958583da-709a-4f27-ba85-903397e277c9 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.275176 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f67d13-d396-46f1-858f-d198b3254853 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.280585 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f5196-6a37-4636-885c-18a26df8caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.281282 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f5196-6a37-4636-885c-18a26df8caf4 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.281553 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f5196-6a37-4636-885c-18a26df8caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.281869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f5196-6a37-4636-885c-18a26df8caf4 None admin] PATH_INFO: `/v3/services/network` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.282494 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f5196-6a37-4636-885c-18a26df8caf4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.284045 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f5196-6a37-4636-885c-18a26df8caf4 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-842f5196-6a37-4636-885c-18a26df8caf4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:14.297009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:14.299400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:14.301238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 365/733] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:14 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:14.307431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f5196-6a37-4636-885c-18a26df8caf4 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.315033 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32d95d-3038-4f35-9b1b-31efa48fd385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.315760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32d95d-3038-4f35-9b1b-31efa48fd385 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.316122 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32d95d-3038-4f35-9b1b-31efa48fd385 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.316473 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32d95d-3038-4f35-9b1b-31efa48fd385 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.317176 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32d95d-3038-4f35-9b1b-31efa48fd385 None admin] RBAC: Adding query filter params (name=image) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:14.317624 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32d95d-3038-4f35-9b1b-31efa48fd385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.319300 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32d95d-3038-4f35-9b1b-31efa48fd385 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.330536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 369/734] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:14.332022 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32d95d-3038-4f35-9b1b-31efa48fd385 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.337394 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:14.395698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:14.448344 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f5196-6a37-4636-885c-18a26df8caf4 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.474041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32d95d-3038-4f35-9b1b-31efa48fd385 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.497538 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792556f-b801-4ede-b32a-fd3087264ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.498211 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792556f-b801-4ede-b32a-fd3087264ad2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.498995 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792556f-b801-4ede-b32a-fd3087264ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.498995 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792556f-b801-4ede-b32a-fd3087264ad2 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.499539 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792556f-b801-4ede-b32a-fd3087264ad2 None admin] RBAC: Adding query filter params (name=network) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:14.499842 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792556f-b801-4ede-b32a-fd3087264ad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.501291 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792556f-b801-4ede-b32a-fd3087264ad2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.512842 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 366/735] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:14.513905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792556f-b801-4ede-b32a-fd3087264ad2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.533785 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3658f5d-a077-453e-b96c-9f04a76b4e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.534942 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3658f5d-a077-453e-b96c-9f04a76b4e46 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.535362 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3658f5d-a077-453e-b96c-9f04a76b4e46 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.535939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3658f5d-a077-453e-b96c-9f04a76b4e46 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.536241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3658f5d-a077-453e-b96c-9f04a76b4e46 None admin] RBAC: Adding query filter params (type=image) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:14.536537 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3658f5d-a077-453e-b96c-9f04a76b4e46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.538144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3658f5d-a077-453e-b96c-9f04a76b4e46 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.544925 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 370/736] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:14.545836 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3658f5d-a077-453e-b96c-9f04a76b4e46 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.649771 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792556f-b801-4ede-b32a-fd3087264ad2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.651834 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:14.689251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:14.699779 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db469a-70c8-497e-93bd-fecff9c40939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.700425 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db469a-70c8-497e-93bd-fecff9c40939 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.700744 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db469a-70c8-497e-93bd-fecff9c40939 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.701040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db469a-70c8-497e-93bd-fecff9c40939 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.701803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db469a-70c8-497e-93bd-fecff9c40939 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.703396 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db469a-70c8-497e-93bd-fecff9c40939 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.707163 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3658f5d-a077-453e-b96c-9f04a76b4e46 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-a4db469a-70c8-497e-93bd-fecff9c40939 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:14.714309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:14.715355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:14.716275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 367/737] 10.222.0.47 () {56 vars in 1129 bytes} [Tue Aug 23 16:11:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:14.717093 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db469a-70c8-497e-93bd-fecff9c40939 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.752218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6515d31-90ee-4836-ba44-d3b71e5b01b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.753269 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6515d31-90ee-4836-ba44-d3b71e5b01b1 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.753749 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6515d31-90ee-4836-ba44-d3b71e5b01b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.754256 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6515d31-90ee-4836-ba44-d3b71e5b01b1 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.755119 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6515d31-90ee-4836-ba44-d3b71e5b01b1 None admin] RBAC: Adding query filter params (type=network) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:14.755488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6515d31-90ee-4836-ba44-d3b71e5b01b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.757403 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6515d31-90ee-4836-ba44-d3b71e5b01b1 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.762743 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 371/738] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:14.763380 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6515d31-90ee-4836-ba44-d3b71e5b01b1 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.853101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db469a-70c8-497e-93bd-fecff9c40939 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.895829 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ea4c3-e960-4cf9-9df3-8ee567292236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.896317 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6515d31-90ee-4836-ba44-d3b71e5b01b1 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.896475 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ea4c3-e960-4cf9-9df3-8ee567292236 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.896725 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ea4c3-e960-4cf9-9df3-8ee567292236 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.896987 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ea4c3-e960-4cf9-9df3-8ee567292236 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.897658 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ea4c3-e960-4cf9-9df3-8ee567292236 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.899081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ea4c3-e960-4cf9-9df3-8ee567292236 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.929018 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 368/739] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 23 16:11:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:14.935072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ea4c3-e960-4cf9-9df3-8ee567292236 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.942262 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:14.968550 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b274dc1-ebed-4bac-be5e-a5d14d39dbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.969518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b274dc1-ebed-4bac-be5e-a5d14d39dbd0 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.969975 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b274dc1-ebed-4bac-be5e-a5d14d39dbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.970451 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b274dc1-ebed-4bac-be5e-a5d14d39dbd0 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.971348 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b274dc1-ebed-4bac-be5e-a5d14d39dbd0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:14.971932 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b274dc1-ebed-4bac-be5e-a5d14d39dbd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.974265 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b274dc1-ebed-4bac-be5e-a5d14d39dbd0 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.986346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 372/740] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Aug 23 16:11:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:14.988075 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b274dc1-ebed-4bac-be5e-a5d14d39dbd0 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:15.033704 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:15.106214 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ea4c3-e960-4cf9-9df3-8ee567292236 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:15.115472 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b274dc1-ebed-4bac-be5e-a5d14d39dbd0 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:15.149474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdc6d7-b964-4083-a90d-b5b7e071e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:15.150289 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdc6d7-b964-4083-a90d-b5b7e071e6c4 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:15.150680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdc6d7-b964-4083-a90d-b5b7e071e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:15.151048 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdc6d7-b964-4083-a90d-b5b7e071e6c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:15.151914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdc6d7-b964-4083-a90d-b5b7e071e6c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:15.153498 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdc6d7-b964-4083-a90d-b5b7e071e6c4 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:15.155221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07176a44-f4ed-45d0-b006-fff712dd00cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:15.156013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07176a44-f4ed-45d0-b006-fff712dd00cc None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:15.156558 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07176a44-f4ed-45d0-b006-fff712dd00cc None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:15.156968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07176a44-f4ed-45d0-b006-fff712dd00cc None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:15.157821 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07176a44-f4ed-45d0-b006-fff712dd00cc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:15.158376 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07176a44-f4ed-45d0-b006-fff712dd00cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:15.160370 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07176a44-f4ed-45d0-b006-fff712dd00cc None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:15.173089 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 373/741] 10.222.0.47 () {56 vars in 1124 bytes} [Tue Aug 23 16:11:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:15.174871 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07176a44-f4ed-45d0-b006-fff712dd00cc None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:15.182591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 369/742] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 23 16:11:14 2022] POST /identity/v3/endpoints => generated 337 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:15.261001 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:15.317794 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07176a44-f4ed-45d0-b006-fff712dd00cc None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:15.362501 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402e501-e900-4992-be44-d1497d6cdb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:15.363515 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402e501-e900-4992-be44-d1497d6cdb8c None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:15.363981 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402e501-e900-4992-be44-d1497d6cdb8c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:15.364423 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402e501-e900-4992-be44-d1497d6cdb8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:15.365348 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402e501-e900-4992-be44-d1497d6cdb8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:15.367117 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402e501-e900-4992-be44-d1497d6cdb8c None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:15.398058 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 374/743] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 23 16:11:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:11:16.161073 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ea7e7-0d59-47f7-8f3a-4aa3a175ef27 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:16.161706 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ea7e7-0d59-47f7-8f3a-4aa3a175ef27 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:16.161706 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ea7e7-0d59-47f7-8f3a-4aa3a175ef27 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:16.163167 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 370/744] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:16.168968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ce87-7dd1-4dc7-b146-d802d913f340 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:16.169255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ce87-7dd1-4dc7-b146-d802d913f340 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:16.169513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ce87-7dd1-4dc7-b146-d802d913f340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:16.188795 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-7720ce87-7dd1-4dc7-b146-d802d913f340 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:16.190028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-7720ce87-7dd1-4dc7-b146-d802d913f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:16.286786 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 375/745] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:16 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:16.610559 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ea7e7-0d59-47f7-8f3a-4aa3a175ef27 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:16.724682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ea7e7-0d59-47f7-8f3a-4aa3a175ef27 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:16.727136 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:16.765485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861b6f5-b0df-43cf-8311-72993908ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:16.766080 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861b6f5-b0df-43cf-8311-72993908ad22 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:16.766336 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861b6f5-b0df-43cf-8311-72993908ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:16.766608 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861b6f5-b0df-43cf-8311-72993908ad22 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:16.767196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861b6f5-b0df-43cf-8311-72993908ad22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:16.768574 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861b6f5-b0df-43cf-8311-72993908ad22 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-b861b6f5-b0df-43cf-8311-72993908ad22 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:16.777659 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:16.778798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:11:16.779710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:16.782440 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 371/746] 10.222.0.47 () {56 vars in 1132 bytes} [Tue Aug 23 16:11:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:16.785261 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720ce87-7dd1-4dc7-b146-d802d913f340 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:16.821900 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:16.895133 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720ce87-7dd1-4dc7-b146-d802d913f340 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:16.933574 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b434fc-0948-451a-b48e-643e6b75c5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:16.934223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b434fc-0948-451a-b48e-643e6b75c5dd None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:16.934494 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b434fc-0948-451a-b48e-643e6b75c5dd None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:16.934763 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b434fc-0948-451a-b48e-643e6b75c5dd None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:16.935393 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b434fc-0948-451a-b48e-643e6b75c5dd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:16.935692 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b434fc-0948-451a-b48e-643e6b75c5dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:16.937062 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b434fc-0948-451a-b48e-643e6b75c5dd None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:16.942068 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 376/747] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 23 16:11:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:16.947740 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861b6f5-b0df-43cf-8311-72993908ad22 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:17.064026 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861b6f5-b0df-43cf-8311-72993908ad22 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:17.100814 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5335f-0e01-4233-8b9c-646335e2d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:17.101420 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5335f-0e01-4233-8b9c-646335e2d432 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:17.101701 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5335f-0e01-4233-8b9c-646335e2d432 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:17.101971 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5335f-0e01-4233-8b9c-646335e2d432 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:17.102665 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5335f-0e01-4233-8b9c-646335e2d432 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:17.102966 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5335f-0e01-4233-8b9c-646335e2d432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:17.104354 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5335f-0e01-4233-8b9c-646335e2d432 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:17.109368 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 372/748] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 23 16:11:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:17.393755 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d744817-b8f1-463b-be30-05116b4f9951 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:17.393933 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d744817-b8f1-463b-be30-05116b4f9951 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:17.394227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d744817-b8f1-463b-be30-05116b4f9951 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:17.395667 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 377/749] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:17.407491 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d39b7-43d7-459f-85ac-17244d9545d3 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:17.407988 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d39b7-43d7-459f-85ac-17244d9545d3 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:17.408183 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d39b7-43d7-459f-85ac-17244d9545d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:17.430966 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-490d39b7-43d7-459f-85ac-17244d9545d3 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:17.432303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-490d39b7-43d7-459f-85ac-17244d9545d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:17.468118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:17.546031 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 373/750] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:17 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:17.653225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdc01f-4727-4608-9bd4-d8df6e7cb8dc None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:17.653413 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdc01f-4727-4608-9bd4-d8df6e7cb8dc None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:17.653684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdc01f-4727-4608-9bd4-d8df6e7cb8dc None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:17.655188 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 378/751] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:17.660859 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8b9eb-633f-4c37-bbce-9c736037016b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:17.661135 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8b9eb-633f-4c37-bbce-9c736037016b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:17.661413 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8b9eb-633f-4c37-bbce-9c736037016b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:17.682580 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-daf8b9eb-633f-4c37-bbce-9c736037016b None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:17.683813 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-daf8b9eb-633f-4c37-bbce-9c736037016b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:17.760214 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 374/752] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:17 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:17.873967 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdc01f-4727-4608-9bd4-d8df6e7cb8dc None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:17.980268 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:17.985988 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdc01f-4727-4608-9bd4-d8df6e7cb8dc None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:18.023939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24217007-4632-4343-8663-d14277905bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:18.024854 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24217007-4632-4343-8663-d14277905bdd None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:18.025130 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24217007-4632-4343-8663-d14277905bdd None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:18.025402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24217007-4632-4343-8663-d14277905bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:18.092289 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8b9eb-633f-4c37-bbce-9c736037016b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:18.103186 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24217007-4632-4343-8663-d14277905bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:18.104825 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24217007-4632-4343-8663-d14277905bdd None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:18.224761 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:18.240138 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8b9eb-633f-4c37-bbce-9c736037016b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:18.253199 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:18.265253 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 379/753] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:17 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:11:18.266710 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24217007-4632-4343-8663-d14277905bdd None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:18.292290 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ccf3-e4ea-43de-b7ac-edc31dfe4258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:18.293221 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ccf3-e4ea-43de-b7ac-edc31dfe4258 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:18.294363 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ccf3-e4ea-43de-b7ac-edc31dfe4258 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:18.294363 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ccf3-e4ea-43de-b7ac-edc31dfe4258 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:18.294972 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41ccf3-e4ea-43de-b7ac-edc31dfe4258 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:18.297123 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41ccf3-e4ea-43de-b7ac-edc31dfe4258 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-fa41ccf3-e4ea-43de-b7ac-edc31dfe4258 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:18.310975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:18.312145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:18.314841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 375/754] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:18.319122 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ccf3-e4ea-43de-b7ac-edc31dfe4258 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:18.389939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24217007-4632-4343-8663-d14277905bdd None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:18.440056 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847d033-e051-432c-a0f9-0c468df18ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:18.440804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847d033-e051-432c-a0f9-0c468df18ae8 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:18.441090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847d033-e051-432c-a0f9-0c468df18ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:18.441391 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847d033-e051-432c-a0f9-0c468df18ae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:18.447061 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ccf3-e4ea-43de-b7ac-edc31dfe4258 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:18.452413 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847d033-e051-432c-a0f9-0c468df18ae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:18.453909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847d033-e051-432c-a0f9-0c468df18ae8 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-0847d033-e051-432c-a0f9-0c468df18ae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:11:18.470706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:18.471820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:11:18.472804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:11:18.472804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:18.472804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:18.472804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 380/755] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:18.480275 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847d033-e051-432c-a0f9-0c468df18ae8 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:18.506920 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4974bf-0749-40d7-b8b4-96a88e0d7de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:18.507883 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4974bf-0749-40d7-b8b4-96a88e0d7de3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:18.508337 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4974bf-0749-40d7-b8b4-96a88e0d7de3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:18.508777 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4974bf-0749-40d7-b8b4-96a88e0d7de3 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:18.509527 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4974bf-0749-40d7-b8b4-96a88e0d7de3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:18.509835 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4974bf-0749-40d7-b8b4-96a88e0d7de3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:18.511303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4974bf-0749-40d7-b8b4-96a88e0d7de3 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:18.517175 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 376/756] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:18.522753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4974bf-0749-40d7-b8b4-96a88e0d7de3 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:18.547848 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:18.548965 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:18.619719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847d033-e051-432c-a0f9-0c468df18ae8 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:18.643356 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4974bf-0749-40d7-b8b4-96a88e0d7de3 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:18.661739 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916eb4d-b194-4f51-b195-823f540772fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:18.662371 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916eb4d-b194-4f51-b195-823f540772fb None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:18.662656 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916eb4d-b194-4f51-b195-823f540772fb None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:18.663135 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916eb4d-b194-4f51-b195-823f540772fb None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:18.663605 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916eb4d-b194-4f51-b195-823f540772fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:18.663862 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916eb4d-b194-4f51-b195-823f540772fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:18.665287 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916eb4d-b194-4f51-b195-823f540772fb None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:18.686040 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 381/757] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:18.686293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d2ae3-5496-4801-94be-0413fc063778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:18.686293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d2ae3-5496-4801-94be-0413fc063778 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:18.686293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d2ae3-5496-4801-94be-0413fc063778 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:18.686293 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d2ae3-5496-4801-94be-0413fc063778 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:18.686701 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d2ae3-5496-4801-94be-0413fc063778 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:18.686701 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d2ae3-5496-4801-94be-0413fc063778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:18.686701 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d2ae3-5496-4801-94be-0413fc063778 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:18.694233 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 377/758] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:19.396266 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb4594-af63-45c1-ae5d-55d588ce8f1f None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:19.396918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb4594-af63-45c1-ae5d-55d588ce8f1f None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:19.396918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb4594-af63-45c1-ae5d-55d588ce8f1f None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:19.398437 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 382/759] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:19.404460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fdd98-ed13-4873-bfe8-e29d562e5d6b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:19.404812 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fdd98-ed13-4873-bfe8-e29d562e5d6b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:19.405150 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fdd98-ed13-4873-bfe8-e29d562e5d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:19.424546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-876fdd98-ed13-4873-bfe8-e29d562e5d6b None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:19.425722 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-876fdd98-ed13-4873-bfe8-e29d562e5d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:19.498254 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 378/760] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:19 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:19.818601 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb4594-af63-45c1-ae5d-55d588ce8f1f None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:19.924504 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb4594-af63-45c1-ae5d-55d588ce8f1f None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:19.935733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:19.959273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ab7bb-ec41-4960-a5be-0f764ff793e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:19.959880 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab7bb-ec41-4960-a5be-0f764ff793e5 None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:19.960162 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab7bb-ec41-4960-a5be-0f764ff793e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:19.960457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab7bb-ec41-4960-a5be-0f764ff793e5 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:19.961088 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ab7bb-ec41-4960-a5be-0f764ff793e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:19.962519 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ab7bb-ec41-4960-a5be-0f764ff793e5 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:19.977554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 383/761] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 23 16:11:19 2022] POST /identity/v3/services => generated 269 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:20.899044 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c889-f04a-440c-af97-c6a1a32cd9b6 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:20.899586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c889-f04a-440c-af97-c6a1a32cd9b6 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:20.899586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c889-f04a-440c-af97-c6a1a32cd9b6 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:20.900866 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 379/762] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:20.906477 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699c75f-4ff6-4ceb-b668-55e9de501379 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:20.906915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699c75f-4ff6-4ceb-b668-55e9de501379 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:20.907116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699c75f-4ff6-4ceb-b668-55e9de501379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:20.929355 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-3699c75f-4ff6-4ceb-b668-55e9de501379 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:20.931231 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-3699c75f-4ff6-4ceb-b668-55e9de501379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:21.017246 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 384/763] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:20 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:21.359009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82c889-f04a-440c-af97-c6a1a32cd9b6 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:21.375020 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:21.462096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82c889-f04a-440c-af97-c6a1a32cd9b6 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:21.506225 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2622dbb-f19d-40c9-8e37-ea6d3e13825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:21.506854 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2622dbb-f19d-40c9-8e37-ea6d3e13825f None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:21.507127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2622dbb-f19d-40c9-8e37-ea6d3e13825f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:21.507391 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2622dbb-f19d-40c9-8e37-ea6d3e13825f None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:21.508039 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2622dbb-f19d-40c9-8e37-ea6d3e13825f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:21.509579 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2622dbb-f19d-40c9-8e37-ea6d3e13825f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:21.528576 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 380/764] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 23 16:11:21 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:22.219248 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd813f1f-ba89-4e01-967a-3de1e436beca None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:22.219813 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd813f1f-ba89-4e01-967a-3de1e436beca None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:22.219813 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd813f1f-ba89-4e01-967a-3de1e436beca None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:22.221201 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 385/765] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:22.226933 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac5a06-f5e8-412d-8cf5-0a79711b6af1 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:22.227402 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac5a06-f5e8-412d-8cf5-0a79711b6af1 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:22.227491 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac5a06-f5e8-412d-8cf5-0a79711b6af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:22.247573 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-7bac5a06-f5e8-412d-8cf5-0a79711b6af1 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:22.248833 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-7bac5a06-f5e8-412d-8cf5-0a79711b6af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:22.322922 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:22.331324 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 381/766] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:22 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:22.650145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd813f1f-ba89-4e01-967a-3de1e436beca None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:22.761502 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:22.769806 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd813f1f-ba89-4e01-967a-3de1e436beca None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:22.807277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7f284-9dd4-4ad6-8828-84880fc0472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:22.807903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7f284-9dd4-4ad6-8828-84880fc0472c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:22.808178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7f284-9dd4-4ad6-8828-84880fc0472c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:22.808492 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7f284-9dd4-4ad6-8828-84880fc0472c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:22.808997 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7f284-9dd4-4ad6-8828-84880fc0472c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:22.810422 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7f284-9dd4-4ad6-8828-84880fc0472c None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-bfb7f284-9dd4-4ad6-8828-84880fc0472c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:22.819242 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:22.820922 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:22.821863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 386/767] 10.222.0.47 () {56 vars in 1132 bytes} [Tue Aug 23 16:11:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:22.826644 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac5a06-f5e8-412d-8cf5-0a79711b6af1 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:22.955713 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac5a06-f5e8-412d-8cf5-0a79711b6af1 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:23.011460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f2462-b290-4f77-92fd-c004439f63db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:23.012126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f2462-b290-4f77-92fd-c004439f63db None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.012338 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f2462-b290-4f77-92fd-c004439f63db None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.012605 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f2462-b290-4f77-92fd-c004439f63db None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.013235 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f2462-b290-4f77-92fd-c004439f63db None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:23.013525 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f2462-b290-4f77-92fd-c004439f63db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:23.014921 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f2462-b290-4f77-92fd-c004439f63db None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:23.019833 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 382/768] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 23 16:11:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:23.025729 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7f284-9dd4-4ad6-8828-84880fc0472c None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:23.128572 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7f284-9dd4-4ad6-8828-84880fc0472c None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:23.163084 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02385e78-fd96-4fb6-a9d5-bc0738dd3803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:23.163771 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02385e78-fd96-4fb6-a9d5-bc0738dd3803 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.164050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02385e78-fd96-4fb6-a9d5-bc0738dd3803 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.164315 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02385e78-fd96-4fb6-a9d5-bc0738dd3803 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.164938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02385e78-fd96-4fb6-a9d5-bc0738dd3803 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:23.165230 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02385e78-fd96-4fb6-a9d5-bc0738dd3803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:23.166654 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02385e78-fd96-4fb6-a9d5-bc0738dd3803 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:23.171588 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 387/769] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 23 16:11:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:23.177533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f2462-b290-4f77-92fd-c004439f63db None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:23.249917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:23.289946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f2462-b290-4f77-92fd-c004439f63db None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:23.325436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e657d85-53a9-4803-b9e1-dd04fd4f9c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:23.326093 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e657d85-53a9-4803-b9e1-dd04fd4f9c4b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.326362 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e657d85-53a9-4803-b9e1-dd04fd4f9c4b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.326650 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e657d85-53a9-4803-b9e1-dd04fd4f9c4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.327371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e657d85-53a9-4803-b9e1-dd04fd4f9c4b None admin] RBAC: Adding query filter params (interface=public, service_id=85281af5b6a549aca61f8552051effbf, region_id=RegionOne) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:23.327673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e657d85-53a9-4803-b9e1-dd04fd4f9c4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:23.329098 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e657d85-53a9-4803-b9e1-dd04fd4f9c4b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:23.334375 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 383/770] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 23 16:11:23 2022] GET /identity/v3/endpoints?service_id=85281af5b6a549aca61f8552051effbf&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:23.340686 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02385e78-fd96-4fb6-a9d5-bc0738dd3803 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:23.373879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:23.454375 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02385e78-fd96-4fb6-a9d5-bc0738dd3803 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:23.491688 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde75323-1f74-44da-a1f5-ba29752cdad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:23.492296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde75323-1f74-44da-a1f5-ba29752cdad3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.492544 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde75323-1f74-44da-a1f5-ba29752cdad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.492810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde75323-1f74-44da-a1f5-ba29752cdad3 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.493413 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde75323-1f74-44da-a1f5-ba29752cdad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:23.495447 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde75323-1f74-44da-a1f5-ba29752cdad3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:23.502279 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 388/771] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 23 16:11:23 2022] GET /identity/v3/services => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:11:23.726514 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df3926-c34c-4717-a7bc-640f41ca7ae8 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.726792 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df3926-c34c-4717-a7bc-640f41ca7ae8 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.727065 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df3926-c34c-4717-a7bc-640f41ca7ae8 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.728562 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 384/772] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:23.734216 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99947b45-636d-41d9-825b-41223c40ada1 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.734494 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99947b45-636d-41d9-825b-41223c40ada1 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.734767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99947b45-636d-41d9-825b-41223c40ada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.753461 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-99947b45-636d-41d9-825b-41223c40ada1 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:23.754499 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-99947b45-636d-41d9-825b-41223c40ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:23.822627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 389/773] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:23 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:11:24.147214 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df3926-c34c-4717-a7bc-640f41ca7ae8 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.252770 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df3926-c34c-4717-a7bc-640f41ca7ae8 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.280254 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:24.289118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea8e87-0f25-43b2-be3c-4799fe7acba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.289778 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea8e87-0f25-43b2-be3c-4799fe7acba2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.290083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea8e87-0f25-43b2-be3c-4799fe7acba2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.290346 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea8e87-0f25-43b2-be3c-4799fe7acba2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.291012 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea8e87-0f25-43b2-be3c-4799fe7acba2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.292372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea8e87-0f25-43b2-be3c-4799fe7acba2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-2aea8e87-0f25-43b2-be3c-4799fe7acba2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:24.301389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:24.302609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:24.303554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 385/774] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:24.309015 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99947b45-636d-41d9-825b-41223c40ada1 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.328340 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:24.412324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99947b45-636d-41d9-825b-41223c40ada1 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.448707 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6268dad-5290-4652-a7ba-bf815ffa5c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.449315 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6268dad-5290-4652-a7ba-bf815ffa5c7e None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.449590 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6268dad-5290-4652-a7ba-bf815ffa5c7e None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.449861 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6268dad-5290-4652-a7ba-bf815ffa5c7e None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.450524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6268dad-5290-4652-a7ba-bf815ffa5c7e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:24.450828 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6268dad-5290-4652-a7ba-bf815ffa5c7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.452196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6268dad-5290-4652-a7ba-bf815ffa5c7e None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.456920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 390/775] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:24.462747 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea8e87-0f25-43b2-be3c-4799fe7acba2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.573704 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea8e87-0f25-43b2-be3c-4799fe7acba2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.607549 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f1c89-a125-42f6-8d6b-c12f7f27802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.608166 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f1c89-a125-42f6-8d6b-c12f7f27802e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.608440 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f1c89-a125-42f6-8d6b-c12f7f27802e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.608709 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f1c89-a125-42f6-8d6b-c12f7f27802e None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.609353 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f1c89-a125-42f6-8d6b-c12f7f27802e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:24.609653 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f1c89-a125-42f6-8d6b-c12f7f27802e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.611162 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f1c89-a125-42f6-8d6b-c12f7f27802e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.616953 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 386/776] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:24.624415 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6268dad-5290-4652-a7ba-bf815ffa5c7e None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.709669 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:24.728337 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6268dad-5290-4652-a7ba-bf815ffa5c7e None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.762233 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8f8e4-93cf-495d-a20c-bfe47166ef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.762841 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8f8e4-93cf-495d-a20c-bfe47166ef78 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.763115 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8f8e4-93cf-495d-a20c-bfe47166ef78 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.763377 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8f8e4-93cf-495d-a20c-bfe47166ef78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.764066 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8f8e4-93cf-495d-a20c-bfe47166ef78 None admin] RBAC: Adding query filter params (interface=public, service_id=c7620bb45bb24b04a81ca79315bba7f4, region_id=RegionOne) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:24.764364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8f8e4-93cf-495d-a20c-bfe47166ef78 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.765725 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8f8e4-93cf-495d-a20c-bfe47166ef78 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.772920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 391/777] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/endpoints?service_id=c7620bb45bb24b04a81ca79315bba7f4&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:24.779406 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f1c89-a125-42f6-8d6b-c12f7f27802e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.838914 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:24.883965 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f1c89-a125-42f6-8d6b-c12f7f27802e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.920760 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c752b-b17f-4f6d-8c9c-a183dd1c6791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.921408 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c752b-b17f-4f6d-8c9c-a183dd1c6791 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.921683 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c752b-b17f-4f6d-8c9c-a183dd1c6791 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.921983 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c752b-b17f-4f6d-8c9c-a183dd1c6791 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.922604 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c752b-b17f-4f6d-8c9c-a183dd1c6791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.923991 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c752b-b17f-4f6d-8c9c-a183dd1c6791 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.930395 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 387/778] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/services => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:11:25.701212 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c1ab6-442a-4a73-a960-9b20a7a79d2e None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:25.701874 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c1ab6-442a-4a73-a960-9b20a7a79d2e None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:25.701874 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c1ab6-442a-4a73-a960-9b20a7a79d2e None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:25.703219 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 392/779] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:25.709013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2d637-be7e-48bd-a299-4f005183145c None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:25.709441 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2d637-be7e-48bd-a299-4f005183145c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:25.709639 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2d637-be7e-48bd-a299-4f005183145c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:25.731144 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-48b2d637-be7e-48bd-a299-4f005183145c None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:25.732348 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-48b2d637-be7e-48bd-a299-4f005183145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:25.807121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 388/780] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:25 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:26.143880 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c1ab6-442a-4a73-a960-9b20a7a79d2e None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:26.248519 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c1ab6-442a-4a73-a960-9b20a7a79d2e None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:26.283085 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0de41-2ce7-4fd6-9f35-ef86b2863d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:26.283707 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0de41-2ce7-4fd6-9f35-ef86b2863d17 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:26.283982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0de41-2ce7-4fd6-9f35-ef86b2863d17 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:26.284251 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0de41-2ce7-4fd6-9f35-ef86b2863d17 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:26.284816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0de41-2ce7-4fd6-9f35-ef86b2863d17 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:26.286535 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0de41-2ce7-4fd6-9f35-ef86b2863d17 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-c7f0de41-2ce7-4fd6-9f35-ef86b2863d17 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:26.295490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:26.296486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:26.297887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 393/781] 10.222.0.47 () {56 vars in 1132 bytes} [Tue Aug 23 16:11:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:26.302704 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2d637-be7e-48bd-a299-4f005183145c None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:26.354253 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:26.406168 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2d637-be7e-48bd-a299-4f005183145c None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:26.440730 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2229a-c06b-4b9f-b915-257e9dbdf92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:26.441371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2229a-c06b-4b9f-b915-257e9dbdf92a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:26.441645 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2229a-c06b-4b9f-b915-257e9dbdf92a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:26.441912 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2229a-c06b-4b9f-b915-257e9dbdf92a None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:26.442579 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2229a-c06b-4b9f-b915-257e9dbdf92a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:26.442874 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2229a-c06b-4b9f-b915-257e9dbdf92a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:26.444248 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2229a-c06b-4b9f-b915-257e9dbdf92a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:26.449270 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 389/782] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 23 16:11:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:26.455010 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0de41-2ce7-4fd6-9f35-ef86b2863d17 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:26.468904 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:26.577257 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0de41-2ce7-4fd6-9f35-ef86b2863d17 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:26.612632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108531e5-0680-46d8-b933-c6248d54cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:26.613270 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108531e5-0680-46d8-b933-c6248d54cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:26.613547 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108531e5-0680-46d8-b933-c6248d54cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:26.613818 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108531e5-0680-46d8-b933-c6248d54cfd6 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:26.614491 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108531e5-0680-46d8-b933-c6248d54cfd6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:26.614796 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108531e5-0680-46d8-b933-c6248d54cfd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:26.616189 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108531e5-0680-46d8-b933-c6248d54cfd6 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:26.621800 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 394/783] 10.222.0.47 () {56 vars in 1126 bytes} [Tue Aug 23 16:11:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:26.628168 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2229a-c06b-4b9f-b915-257e9dbdf92a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:26.735172 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2229a-c06b-4b9f-b915-257e9dbdf92a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:26.750165 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:26.773428 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961c981-46bd-425a-906e-964c62573c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:26.774056 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961c981-46bd-425a-906e-964c62573c60 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:26.774336 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961c981-46bd-425a-906e-964c62573c60 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:26.774608 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961c981-46bd-425a-906e-964c62573c60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:26.775344 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961c981-46bd-425a-906e-964c62573c60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:26.776724 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961c981-46bd-425a-906e-964c62573c60 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:26.797903 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 390/784] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 23 16:11:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:11:27.163390 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d39e28-730b-4830-9753-c07c8f6a7990 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:27.163902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d39e28-730b-4830-9753-c07c8f6a7990 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:27.163902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d39e28-730b-4830-9753-c07c8f6a7990 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:27.165163 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 395/785] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:27.171170 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d50c2-77c2-40ac-a0da-6c64ba2ff6e7 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:27.171461 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d50c2-77c2-40ac-a0da-6c64ba2ff6e7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:27.171730 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d50c2-77c2-40ac-a0da-6c64ba2ff6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:27.191526 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-cc7d50c2-77c2-40ac-a0da-6c64ba2ff6e7 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:27.192749 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-cc7d50c2-77c2-40ac-a0da-6c64ba2ff6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:27.273061 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 391/786] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:27 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:27.654697 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d39e28-730b-4830-9753-c07c8f6a7990 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:27.748296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:27.776650 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d39e28-730b-4830-9753-c07c8f6a7990 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:27.816546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ae750-f4e6-4007-894a-d9bd5c7e5a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:27.817181 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ae750-f4e6-4007-894a-d9bd5c7e5a75 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:27.817463 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ae750-f4e6-4007-894a-d9bd5c7e5a75 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:27.817735 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ae750-f4e6-4007-894a-d9bd5c7e5a75 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:27.818353 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ae750-f4e6-4007-894a-d9bd5c7e5a75 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:27.819727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ae750-f4e6-4007-894a-d9bd5c7e5a75 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-f11ae750-f4e6-4007-894a-d9bd5c7e5a75 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:27.829462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:27.830671 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:27.831992 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 396/787] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:27.837691 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d50c2-77c2-40ac-a0da-6c64ba2ff6e7 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:27.943714 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:27.951501 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d50c2-77c2-40ac-a0da-6c64ba2ff6e7 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:27.991673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63634331-306c-4eba-be36-3a97b699cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:27.992311 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63634331-306c-4eba-be36-3a97b699cb19 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:27.992633 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63634331-306c-4eba-be36-3a97b699cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:27.992969 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63634331-306c-4eba-be36-3a97b699cb19 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:27.993583 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63634331-306c-4eba-be36-3a97b699cb19 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:27.993877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63634331-306c-4eba-be36-3a97b699cb19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:27.995324 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63634331-306c-4eba-be36-3a97b699cb19 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:28.001590 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 392/788] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:28.007130 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ae750-f4e6-4007-894a-d9bd5c7e5a75 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:28.114107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ae750-f4e6-4007-894a-d9bd5c7e5a75 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:28.152524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987dc15d-545c-40d1-b33f-bfce99fc6570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:28.153157 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dc15d-545c-40d1-b33f-bfce99fc6570 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:28.153431 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dc15d-545c-40d1-b33f-bfce99fc6570 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:28.153702 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dc15d-545c-40d1-b33f-bfce99fc6570 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:28.154348 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987dc15d-545c-40d1-b33f-bfce99fc6570 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:28.154647 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987dc15d-545c-40d1-b33f-bfce99fc6570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:28.156082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987dc15d-545c-40d1-b33f-bfce99fc6570 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:28.161363 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 397/789] 10.222.0.47 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:28.167593 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63634331-306c-4eba-be36-3a97b699cb19 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:28.273039 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63634331-306c-4eba-be36-3a97b699cb19 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:28.312295 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b24748-c99c-4075-951a-27257ef01225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:28.312970 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b24748-c99c-4075-951a-27257ef01225 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:28.313243 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b24748-c99c-4075-951a-27257ef01225 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:28.313510 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b24748-c99c-4075-951a-27257ef01225 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:28.314272 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b24748-c99c-4075-951a-27257ef01225 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:28.315665 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b24748-c99c-4075-951a-27257ef01225 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:28.337309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 393/790] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 23 16:11:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:11:29.041441 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a04c1-f454-447c-89ad-a06758bf8830 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.042080 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a04c1-f454-447c-89ad-a06758bf8830 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.042080 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a04c1-f454-447c-89ad-a06758bf8830 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.043297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 398/791] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:29.049127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb7dd6-5d4e-4099-90ed-e9f3c04df866 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.049586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb7dd6-5d4e-4099-90ed-e9f3c04df866 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.049729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb7dd6-5d4e-4099-90ed-e9f3c04df866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.069923 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-07eb7dd6-5d4e-4099-90ed-e9f3c04df866 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:29.071301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-07eb7dd6-5d4e-4099-90ed-e9f3c04df866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:29.083416 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:29.153887 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 394/792] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:29 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:29.480807 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a04c1-f454-447c-89ad-a06758bf8830 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:29.483794 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:29.592362 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a04c1-f454-447c-89ad-a06758bf8830 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:29.627017 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6fbe9-0e65-47ac-9b29-1c8d7f590241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:29.627652 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6fbe9-0e65-47ac-9b29-1c8d7f590241 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.627928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6fbe9-0e65-47ac-9b29-1c8d7f590241 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.628210 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6fbe9-0e65-47ac-9b29-1c8d7f590241 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.628785 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6fbe9-0e65-47ac-9b29-1c8d7f590241 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:29.630189 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6fbe9-0e65-47ac-9b29-1c8d7f590241 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-5ce6fbe9-0e65-47ac-9b29-1c8d7f590241 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:29.639510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:29.640521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:29.641546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 399/793] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:29.646670 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb7dd6-5d4e-4099-90ed-e9f3c04df866 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:29.759373 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb7dd6-5d4e-4099-90ed-e9f3c04df866 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:29.794386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc597700-ef8d-4d65-8191-cb4360160c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:29.795001 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc597700-ef8d-4d65-8191-cb4360160c75 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.795278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc597700-ef8d-4d65-8191-cb4360160c75 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.795549 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc597700-ef8d-4d65-8191-cb4360160c75 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.796157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc597700-ef8d-4d65-8191-cb4360160c75 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:29.796481 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc597700-ef8d-4d65-8191-cb4360160c75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:29.797853 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc597700-ef8d-4d65-8191-cb4360160c75 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:29.802886 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 395/794] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:29.808697 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6fbe9-0e65-47ac-9b29-1c8d7f590241 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:29.884894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:29.923807 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6fbe9-0e65-47ac-9b29-1c8d7f590241 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:29.958225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5aba2-898f-401f-add7-1e795c2e5261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:29.958824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5aba2-898f-401f-add7-1e795c2e5261 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.959094 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5aba2-898f-401f-add7-1e795c2e5261 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.959421 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5aba2-898f-401f-add7-1e795c2e5261 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.959985 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5aba2-898f-401f-add7-1e795c2e5261 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:29.960273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5aba2-898f-401f-add7-1e795c2e5261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:29.961628 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5aba2-898f-401f-add7-1e795c2e5261 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:29.966940 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 400/795] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:30.551029 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3b7d3-a37c-45bf-a880-dbd11bc8aad9 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:30.551612 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3b7d3-a37c-45bf-a880-dbd11bc8aad9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:30.551612 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3b7d3-a37c-45bf-a880-dbd11bc8aad9 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:30.552922 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 396/796] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:30.558758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5c22b-842c-452d-b2f8-a336b6c854e0 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:30.559198 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5c22b-842c-452d-b2f8-a336b6c854e0 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:30.559377 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5c22b-842c-452d-b2f8-a336b6c854e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:30.584067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-c9d5c22b-842c-452d-b2f8-a336b6c854e0 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:30.585270 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-c9d5c22b-842c-452d-b2f8-a336b6c854e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:30.662351 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 401/797] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:30 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:11:30.984835 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3b7d3-a37c-45bf-a880-dbd11bc8aad9 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.001702 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:31.111238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3b7d3-a37c-45bf-a880-dbd11bc8aad9 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.148085 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df7ae1-ae11-4655-91c1-1eee2845d32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.148692 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df7ae1-ae11-4655-91c1-1eee2845d32c None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.149012 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df7ae1-ae11-4655-91c1-1eee2845d32c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.149344 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df7ae1-ae11-4655-91c1-1eee2845d32c None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.149977 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df7ae1-ae11-4655-91c1-1eee2845d32c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.151739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df7ae1-ae11-4655-91c1-1eee2845d32c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.154770 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: WARNING keystone.server.flask.common [None req-93df7ae1-ae11-4655-91c1-1eee2845d32c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 16:11:31.174397 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.sql.core [None req-93df7ae1-ae11-4655-91c1-1eee2845d32c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 16:11:31.174397 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 16:11:31.174397 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [parameters: {'id': 'eab9f8060847467b94aed9db06db967d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 16:11:31.174397 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88357) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-93df7ae1-ae11-4655-91c1-1eee2845d32c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eab9f8060847467b94aed9db06db967d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eab9f8060847467b94aed9db06db967d. Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:11:31.190902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result.read() Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 16:11:31.191796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application yield resource Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise self.value Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application session.commit() Aug 23 16:11:31.192826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.session.flush() Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application compat.raise_( Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 16:11:31.193831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 16:11:31.194869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result.read() Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:11:31.195817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [parameters: {'id': 'eab9f8060847467b94aed9db06db967d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:31.196870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:31.197807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:31.200304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:31.200304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 16:11:31.200304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 16:11:31.200304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:31.200304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:31.200304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 16:11:31.200304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 16:11:31.200304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eab9f8060847467b94aed9db06db967d. Aug 23 16:11:31.200304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:31.200304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 397/798] 10.222.0.47 () {60 vars in 1140 bytes} [Tue Aug 23 16:11:30 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:31.201151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5c22b-842c-452d-b2f8-a336b6c854e0 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.261679 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:31.304107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5c22b-842c-452d-b2f8-a336b6c854e0 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.353665 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98243929-242c-41cd-9fda-f7f5a25bbfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.354710 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98243929-242c-41cd-9fda-f7f5a25bbfc4 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.355233 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98243929-242c-41cd-9fda-f7f5a25bbfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.355665 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98243929-242c-41cd-9fda-f7f5a25bbfc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.367828 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98243929-242c-41cd-9fda-f7f5a25bbfc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.370443 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98243929-242c-41cd-9fda-f7f5a25bbfc4 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-98243929-242c-41cd-9fda-f7f5a25bbfc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:11:31.390894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:31.391956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:31.393064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:11:31.393064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:11:31.393064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:11:31.393064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:11:31.393064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:11:31.393064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:11:31.393064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:11:31.393064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:31.393064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 402/799] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:31.398738 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df7ae1-ae11-4655-91c1-1eee2845d32c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.477195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:31.524289 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df7ae1-ae11-4655-91c1-1eee2845d32c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.565918 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fa5da-f167-48ad-9fda-e4277fde587e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.567029 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fa5da-f167-48ad-9fda-e4277fde587e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.567029 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fa5da-f167-48ad-9fda-e4277fde587e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.567215 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fa5da-f167-48ad-9fda-e4277fde587e None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.567928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fa5da-f167-48ad-9fda-e4277fde587e None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:31.568262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fa5da-f167-48ad-9fda-e4277fde587e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.570382 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fa5da-f167-48ad-9fda-e4277fde587e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.721441 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 398/800] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:32.191471 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479c7f4-4bc3-479e-ad4a-0347986ebdff None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:32.192025 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479c7f4-4bc3-479e-ad4a-0347986ebdff None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:32.192025 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479c7f4-4bc3-479e-ad4a-0347986ebdff None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:32.193352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 403/801] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:32.199662 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e321af-6ee5-46c5-8bb0-27ad778f069a None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:32.199952 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e321af-6ee5-46c5-8bb0-27ad778f069a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:32.200225 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e321af-6ee5-46c5-8bb0-27ad778f069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:32.220637 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-00e321af-6ee5-46c5-8bb0-27ad778f069a None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:32.222204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-00e321af-6ee5-46c5-8bb0-27ad778f069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:32.297790 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 399/802] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:32 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:11:32.620381 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479c7f4-4bc3-479e-ad4a-0347986ebdff None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:32.735095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479c7f4-4bc3-479e-ad4a-0347986ebdff None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:32.757506 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:32.774281 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01e3e7-b420-4c51-9694-196c6fd3bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:32.774970 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e3e7-b420-4c51-9694-196c6fd3bc8b None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:32.775248 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e3e7-b420-4c51-9694-196c6fd3bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:32.775548 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e3e7-b420-4c51-9694-196c6fd3bc8b None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:32.776334 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01e3e7-b420-4c51-9694-196c6fd3bc8b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:32.777899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01e3e7-b420-4c51-9694-196c6fd3bc8b None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:32.797770 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 404/803] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 23 16:11:32 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:34.008251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012eec3-0eef-42f4-a8ed-ec4a3a42b147 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:34.008796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012eec3-0eef-42f4-a8ed-ec4a3a42b147 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:34.008796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012eec3-0eef-42f4-a8ed-ec4a3a42b147 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:34.010221 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 400/804] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:34.016167 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39c17-8d98-4454-bac2-51916197ad44 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:34.016653 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39c17-8d98-4454-bac2-51916197ad44 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:34.016912 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39c17-8d98-4454-bac2-51916197ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:34.044592 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-31b39c17-8d98-4454-bac2-51916197ad44 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:34.045786 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-31b39c17-8d98-4454-bac2-51916197ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:34.128484 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 405/805] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:34 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:34.454269 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012eec3-0eef-42f4-a8ed-ec4a3a42b147 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:34.532851 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:34.593371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012eec3-0eef-42f4-a8ed-ec4a3a42b147 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:34.629219 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a010e6a-0ce0-4980-9d92-7b2c21216505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:34.629808 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a010e6a-0ce0-4980-9d92-7b2c21216505 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:34.630111 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a010e6a-0ce0-4980-9d92-7b2c21216505 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:34.630399 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a010e6a-0ce0-4980-9d92-7b2c21216505 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:34.631015 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a010e6a-0ce0-4980-9d92-7b2c21216505 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:34.632454 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a010e6a-0ce0-4980-9d92-7b2c21216505 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:34.647677 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.sql.core [None req-3a010e6a-0ce0-4980-9d92-7b2c21216505 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 16:11:34.647677 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 16:11:34.647677 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [parameters: {'user_id': '36041c9a9bab47e098dd5d5668be5e32', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 16:11:34.647677 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88357) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-3a010e6a-0ce0-4980-9d92-7b2c21216505 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result.read() Aug 23 16:11:34.655876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:11:34.657259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application yield resource Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise self.value Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application session.commit() Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 16:11:34.658695 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.session.flush() Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application compat.raise_( Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 16:11:34.659591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:11:34.660468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result.read() Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:11:34.661638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [parameters: {'user_id': '36041c9a9bab47e098dd5d5668be5e32', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:34.666858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 16:11:34.667780 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 16:11:34.668852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 16:11:34.668852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 16:11:34.668852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 16:11:34.668852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 16:11:34.668852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 16:11:34.668852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:34.668852 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 401/806] 10.222.0.47 () {60 vars in 1131 bytes} [Tue Aug 23 16:11:34 2022] POST /identity/v3/users => generated 160 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:34.669308 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b39c17-8d98-4454-bac2-51916197ad44 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:34.777564 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b39c17-8d98-4454-bac2-51916197ad44 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:34.785595 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:34.815843 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2b328-cd2a-4018-b843-fd77c3035cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:34.816501 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2b328-cd2a-4018-b843-fd77c3035cf5 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:34.816774 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2b328-cd2a-4018-b843-fd77c3035cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:34.817044 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2b328-cd2a-4018-b843-fd77c3035cf5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:34.825216 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2b328-cd2a-4018-b843-fd77c3035cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:34.826695 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2b328-cd2a-4018-b843-fd77c3035cf5 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-ebb2b328-cd2a-4018-b843-fd77c3035cf5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:11:34.839758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:34.840937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:34.842032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:34.842032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:34.842032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:11:34.842032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:11:34.842032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:11:34.842032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:11:34.842032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:11:34.842032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:11:34.842032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:11:34.842032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:34.842032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 406/807] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:34.849069 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a010e6a-0ce0-4980-9d92-7b2c21216505 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:34.975939 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a010e6a-0ce0-4980-9d92-7b2c21216505 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:34.996983 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:35.015888 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74838939-1305-4567-aedc-954d4e6e433c None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:35.016255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74838939-1305-4567-aedc-954d4e6e433c None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:35.016872 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74838939-1305-4567-aedc-954d4e6e433c None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:35.017975 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 407/808] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:35.023270 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2089-aef3-4674-afbb-81a67ef35f82 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:35.023546 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2089-aef3-4674-afbb-81a67ef35f82 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:35.023892 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2089-aef3-4674-afbb-81a67ef35f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:35.028464 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f59759-7047-4238-a335-4d9e6ca0f369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:35.029405 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f59759-7047-4238-a335-4d9e6ca0f369 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:35.029801 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f59759-7047-4238-a335-4d9e6ca0f369 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:35.030260 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f59759-7047-4238-a335-4d9e6ca0f369 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:35.031363 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f59759-7047-4238-a335-4d9e6ca0f369 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:35.031784 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f59759-7047-4238-a335-4d9e6ca0f369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:35.034880 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f59759-7047-4238-a335-4d9e6ca0f369 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:35.049195 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-d1ad2089-aef3-4674-afbb-81a67ef35f82 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:35.050448 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-d1ad2089-aef3-4674-afbb-81a67ef35f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:35.079065 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 402/809] 10.222.0.47 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:35.129842 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 408/810] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:35 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:11:35.452075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f59759-7047-4238-a335-4d9e6ca0f369 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:35.567406 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f59759-7047-4238-a335-4d9e6ca0f369 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:35.602448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210473-b92a-41db-a388-1308c7004ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:35.603080 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210473-b92a-41db-a388-1308c7004ee3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:35.603358 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210473-b92a-41db-a388-1308c7004ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:35.603634 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210473-b92a-41db-a388-1308c7004ee3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:35.604269 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e210473-b92a-41db-a388-1308c7004ee3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:35.605646 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e210473-b92a-41db-a388-1308c7004ee3 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-9e210473-b92a-41db-a388-1308c7004ee3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:35.615130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:35.616278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:11:35.617105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 403/811] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:35.622510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad2089-aef3-4674-afbb-81a67ef35f82 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:35.732908 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:35.739883 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad2089-aef3-4674-afbb-81a67ef35f82 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:35.774786 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0362-a96f-4dc0-a4b0-d3835cd87171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:35.775392 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0362-a96f-4dc0-a4b0-d3835cd87171 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:35.775666 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0362-a96f-4dc0-a4b0-d3835cd87171 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:35.775974 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0362-a96f-4dc0-a4b0-d3835cd87171 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:35.776595 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba0362-a96f-4dc0-a4b0-d3835cd87171 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:35.776890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba0362-a96f-4dc0-a4b0-d3835cd87171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:35.778293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba0362-a96f-4dc0-a4b0-d3835cd87171 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:35.783039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 409/812] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:35.789400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210473-b92a-41db-a388-1308c7004ee3 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:35.827374 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:35.913283 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210473-b92a-41db-a388-1308c7004ee3 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:35.948840 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e44c0-b8c4-483c-bb12-6b6b2b53f4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:35.949438 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e44c0-b8c4-483c-bb12-6b6b2b53f4ac None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:35.949705 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e44c0-b8c4-483c-bb12-6b6b2b53f4ac None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:35.949969 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e44c0-b8c4-483c-bb12-6b6b2b53f4ac None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:35.950630 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e44c0-b8c4-483c-bb12-6b6b2b53f4ac None admin] RBAC: Adding query filter params (type=compute) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:35.950923 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e44c0-b8c4-483c-bb12-6b6b2b53f4ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:35.952289 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e44c0-b8c4-483c-bb12-6b6b2b53f4ac None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:35.957505 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 404/813] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:35.966679 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0362-a96f-4dc0-a4b0-d3835cd87171 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:36.094576 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0362-a96f-4dc0-a4b0-d3835cd87171 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:36.132861 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5d742-fc5d-48e6-8bc5-ad27b928560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:36.133475 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5d742-fc5d-48e6-8bc5-ad27b928560c None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:36.133749 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5d742-fc5d-48e6-8bc5-ad27b928560c None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:36.134079 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5d742-fc5d-48e6-8bc5-ad27b928560c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:36.134770 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5d742-fc5d-48e6-8bc5-ad27b928560c None admin] RBAC: Adding query filter params (interface=public, service_id=4b5886e823524fcd8d3a2d49e81da687, region_id=RegionOne) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:36.135083 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5d742-fc5d-48e6-8bc5-ad27b928560c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:36.136507 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5d742-fc5d-48e6-8bc5-ad27b928560c None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:36.141710 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 410/814] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 23 16:11:35 2022] GET /identity/v3/endpoints?service_id=4b5886e823524fcd8d3a2d49e81da687&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:36.147657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e44c0-b8c4-483c-bb12-6b6b2b53f4ac None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:36.247596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:36.251239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e44c0-b8c4-483c-bb12-6b6b2b53f4ac None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:36.287704 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d2e1d-6c46-4a2d-a54e-16e8209faa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:36.288307 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d2e1d-6c46-4a2d-a54e-16e8209faa59 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:36.288584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d2e1d-6c46-4a2d-a54e-16e8209faa59 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:36.288862 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d2e1d-6c46-4a2d-a54e-16e8209faa59 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:36.289470 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d2e1d-6c46-4a2d-a54e-16e8209faa59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:36.291283 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d2e1d-6c46-4a2d-a54e-16e8209faa59 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:36.298156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 405/815] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 23 16:11:36 2022] GET /identity/v3/services => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:11:38.524479 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53752a-dd0b-499f-9f19-39e6003434a8 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.525021 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53752a-dd0b-499f-9f19-39e6003434a8 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.525021 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53752a-dd0b-499f-9f19-39e6003434a8 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.526548 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 411/816] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:38.532774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3bc7e-761e-484a-b1e2-0fe80c24142d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.533357 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3bc7e-761e-484a-b1e2-0fe80c24142d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.533357 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3bc7e-761e-484a-b1e2-0fe80c24142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.552533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-76b3bc7e-761e-484a-b1e2-0fe80c24142d None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:38.554108 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-76b3bc7e-761e-484a-b1e2-0fe80c24142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:38.631966 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 406/817] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:38 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:11:38.970760 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53752a-dd0b-499f-9f19-39e6003434a8 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.000624 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:39.089877 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53752a-dd0b-499f-9f19-39e6003434a8 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.127281 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c7e2-4457-4816-a043-ea7548cecd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.127914 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c7e2-4457-4816-a043-ea7548cecd71 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.128187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c7e2-4457-4816-a043-ea7548cecd71 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.128455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c7e2-4457-4816-a043-ea7548cecd71 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.129033 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c7e2-4457-4816-a043-ea7548cecd71 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.130438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c7e2-4457-4816-a043-ea7548cecd71 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-20f8c7e2-4457-4816-a043-ea7548cecd71 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:39.139513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:39.140680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:11:39.141723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 412/818] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:39.146825 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3bc7e-761e-484a-b1e2-0fe80c24142d None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.249007 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:39.261457 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3bc7e-761e-484a-b1e2-0fe80c24142d None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.314669 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3a08b-2c7a-4763-8f80-9e5a54c8d798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.315576 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3a08b-2c7a-4763-8f80-9e5a54c8d798 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.315974 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3a08b-2c7a-4763-8f80-9e5a54c8d798 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.316250 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3a08b-2c7a-4763-8f80-9e5a54c8d798 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.317061 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3a08b-2c7a-4763-8f80-9e5a54c8d798 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:39.317393 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3a08b-2c7a-4763-8f80-9e5a54c8d798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.318995 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3a08b-2c7a-4763-8f80-9e5a54c8d798 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.326558 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 407/819] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:39.334780 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c7e2-4457-4816-a043-ea7548cecd71 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.467832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:39.486121 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c7e2-4457-4816-a043-ea7548cecd71 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.522533 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32828c-8976-4381-bf5f-442559649436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.523063 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32828c-8976-4381-bf5f-442559649436 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.523332 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32828c-8976-4381-bf5f-442559649436 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.523597 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32828c-8976-4381-bf5f-442559649436 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.524248 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32828c-8976-4381-bf5f-442559649436 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:39.524541 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32828c-8976-4381-bf5f-442559649436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.525899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32828c-8976-4381-bf5f-442559649436 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.530775 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 413/820] 10.222.0.47 () {56 vars in 1112 bytes} [Tue Aug 23 16:11:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:39.537215 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3a08b-2c7a-4763-8f80-9e5a54c8d798 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.658969 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3a08b-2c7a-4763-8f80-9e5a54c8d798 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.698621 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a434e9a-def5-4464-91b8-f85440ad9de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.699226 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a434e9a-def5-4464-91b8-f85440ad9de0 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.699474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a434e9a-def5-4464-91b8-f85440ad9de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.699751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a434e9a-def5-4464-91b8-f85440ad9de0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.700408 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a434e9a-def5-4464-91b8-f85440ad9de0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.701783 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a434e9a-def5-4464-91b8-f85440ad9de0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.728077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 408/821] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 23 16:11:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:49.528358 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=24 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:49.723706 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=92,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:43.897229 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b98b48-8dbc-4328-aebf-f3945c1424a2 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:43.897800 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b98b48-8dbc-4328-aebf-f3945c1424a2 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:43.897800 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b98b48-8dbc-4328-aebf-f3945c1424a2 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:43.899188 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 414/822] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:43.906241 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54486c15-49ef-44e4-bf77-0cb65c2960ad None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:43.906983 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54486c15-49ef-44e4-bf77-0cb65c2960ad None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:43.906983 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54486c15-49ef-44e4-bf77-0cb65c2960ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:43.927596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-54486c15-49ef-44e4-bf77-0cb65c2960ad None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:43.928897 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-54486c15-49ef-44e4-bf77-0cb65c2960ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:44.037208 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 409/823] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:43 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:12:44.368121 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b98b48-8dbc-4328-aebf-f3945c1424a2 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:44.533684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b98b48-8dbc-4328-aebf-f3945c1424a2 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:44.580930 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b646f-8dfc-45df-9e41-62f7ad00b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:44.581899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b646f-8dfc-45df-9e41-62f7ad00b312 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:44.582410 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b646f-8dfc-45df-9e41-62f7ad00b312 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:44.582793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b646f-8dfc-45df-9e41-62f7ad00b312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:44.601248 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b646f-8dfc-45df-9e41-62f7ad00b312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:44.603412 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b646f-8dfc-45df-9e41-62f7ad00b312 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-bf5b646f-8dfc-45df-9e41-62f7ad00b312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:44.627610 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:44.628728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:44.629890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:44.629890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:44.629890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:12:44.629890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 415/824] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:44.635799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54486c15-49ef-44e4-bf77-0cb65c2960ad None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:44.771102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54486c15-49ef-44e4-bf77-0cb65c2960ad None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:44.810489 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:44.823069 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbefe2-6941-4532-96f6-03b46eb473e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:44.823869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbefe2-6941-4532-96f6-03b46eb473e6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:44.824179 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbefe2-6941-4532-96f6-03b46eb473e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:44.824513 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbefe2-6941-4532-96f6-03b46eb473e6 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:44.825210 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbefe2-6941-4532-96f6-03b46eb473e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:44.825536 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbefe2-6941-4532-96f6-03b46eb473e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:44.827213 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbefe2-6941-4532-96f6-03b46eb473e6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:44.843590 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 410/825] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:44.850403 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b646f-8dfc-45df-9e41-62f7ad00b312 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:44.925317 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:44.987469 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b646f-8dfc-45df-9e41-62f7ad00b312 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:45.034264 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d247d-fe43-4678-b08e-77fe6999d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:45.034894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d247d-fe43-4678-b08e-77fe6999d058 None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:45.035190 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d247d-fe43-4678-b08e-77fe6999d058 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:45.035471 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d247d-fe43-4678-b08e-77fe6999d058 None admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:45.036266 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d247d-fe43-4678-b08e-77fe6999d058 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:45.038083 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d247d-fe43-4678-b08e-77fe6999d058 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:45.078043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 416/826] 10.222.0.47 () {60 vars in 1132 bytes} [Tue Aug 23 16:12:44 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:12:47.679194 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee784a81-537b-477a-aade-75d442f95bad None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.679776 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee784a81-537b-477a-aade-75d442f95bad None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.680040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee784a81-537b-477a-aade-75d442f95bad None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.681571 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 411/827] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:47.688320 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cea57-65bd-4fc7-9883-fe8ab169e0e8 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.689139 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cea57-65bd-4fc7-9883-fe8ab169e0e8 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.689336 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cea57-65bd-4fc7-9883-fe8ab169e0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.710878 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-ac6cea57-65bd-4fc7-9883-fe8ab169e0e8 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:47.712245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-ac6cea57-65bd-4fc7-9883-fe8ab169e0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:47.790886 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 417/828] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:47 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:12:48.116586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee784a81-537b-477a-aade-75d442f95bad None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:48.267551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee784a81-537b-477a-aade-75d442f95bad None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.312234 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e7623-cceb-4ad3-b1fd-6132fc503b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.312960 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e7623-cceb-4ad3-b1fd-6132fc503b03 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.313235 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e7623-cceb-4ad3-b1fd-6132fc503b03 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.313505 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e7623-cceb-4ad3-b1fd-6132fc503b03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.328035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e7623-cceb-4ad3-b1fd-6132fc503b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-677e7623-cceb-4ad3-b1fd-6132fc503b03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:48.332925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:48.334013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:12:48.335009 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 412/829] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:48.341536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cea57-65bd-4fc7-9883-fe8ab169e0e8 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:48.388845 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:48.461077 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cea57-65bd-4fc7-9883-fe8ab169e0e8 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.508091 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a08110-ec78-4d12-84a5-e4cb1346c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.508749 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a08110-ec78-4d12-84a5-e4cb1346c900 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.509026 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a08110-ec78-4d12-84a5-e4cb1346c900 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.509295 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a08110-ec78-4d12-84a5-e4cb1346c900 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.509980 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a08110-ec78-4d12-84a5-e4cb1346c900 None admin] RBAC: Adding query filter params (name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:48.510317 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a08110-ec78-4d12-84a5-e4cb1346c900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:48.515455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a08110-ec78-4d12-84a5-e4cb1346c900 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:48.521928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 418/830] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:48.528230 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e7623-cceb-4ad3-b1fd-6132fc503b03 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:48.584114 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:48.646258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e7623-cceb-4ad3-b1fd-6132fc503b03 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.687088 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb04e-6676-4511-94cb-12f86c06dc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.687752 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb04e-6676-4511-94cb-12f86c06dc5e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.687990 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb04e-6676-4511-94cb-12f86c06dc5e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.688254 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb04e-6676-4511-94cb-12f86c06dc5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.699939 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bb04e-6676-4511-94cb-12f86c06dc5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:48.701478 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bb04e-6676-4511-94cb-12f86c06dc5e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-425bb04e-6676-4511-94cb-12f86c06dc5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:48.718466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:48.719698 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:48.721000 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:48.721000 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:48.721000 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:12:48.721000 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 413/831] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:48.726820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a08110-ec78-4d12-84a5-e4cb1346c900 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:48.849429 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:48.854305 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a08110-ec78-4d12-84a5-e4cb1346c900 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.899051 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1081e-5578-4ed5-ae0e-eacc89658719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.899505 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1081e-5578-4ed5-ae0e-eacc89658719 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.899774 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1081e-5578-4ed5-ae0e-eacc89658719 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.900041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1081e-5578-4ed5-ae0e-eacc89658719 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.900685 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1081e-5578-4ed5-ae0e-eacc89658719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:48.900974 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1081e-5578-4ed5-ae0e-eacc89658719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:48.902397 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1081e-5578-4ed5-ae0e-eacc89658719 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:48.922059 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 419/832] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:48.929248 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb04e-6676-4511-94cb-12f86c06dc5e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.079853 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:49.087270 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb04e-6676-4511-94cb-12f86c06dc5e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:49.134093 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be083d-9184-4be9-8575-6a2bea44f778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:49.135041 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be083d-9184-4be9-8575-6a2bea44f778 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.135444 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be083d-9184-4be9-8575-6a2bea44f778 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.135841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be083d-9184-4be9-8575-6a2bea44f778 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.155049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be083d-9184-4be9-8575-6a2bea44f778 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:49.155049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be083d-9184-4be9-8575-6a2bea44f778 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-66be083d-9184-4be9-8575-6a2bea44f778 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:49.168751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:49.170095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:49.171163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:49.171163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:49.171163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:49.171163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:49.171163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:49.171163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:49.171163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:49.171163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:49.171163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:12:49.171163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:12:49.175049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 414/833] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:49.176618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1081e-5578-4ed5-ae0e-eacc89658719 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.301303 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1081e-5578-4ed5-ae0e-eacc89658719 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:49.349149 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47bcc3-4b42-4543-8f9c-68ad4b5aabda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:49.350169 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47bcc3-4b42-4543-8f9c-68ad4b5aabda None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.350578 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47bcc3-4b42-4543-8f9c-68ad4b5aabda None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.351028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47bcc3-4b42-4543-8f9c-68ad4b5aabda None admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.352239 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47bcc3-4b42-4543-8f9c-68ad4b5aabda None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:49.352730 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47bcc3-4b42-4543-8f9c-68ad4b5aabda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:49.354626 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47bcc3-4b42-4543-8f9c-68ad4b5aabda None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:49.383333 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 420/834] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Aug 23 16:12:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:49.393901 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be083d-9184-4be9-8575-6a2bea44f778 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.540727 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be083d-9184-4be9-8575-6a2bea44f778 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:49.588833 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c966104-a957-42e0-9fa1-0bc1187e68d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:49.589613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c966104-a957-42e0-9fa1-0bc1187e68d3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.589936 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c966104-a957-42e0-9fa1-0bc1187e68d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.590276 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c966104-a957-42e0-9fa1-0bc1187e68d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.627611 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:49.675351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c966104-a957-42e0-9fa1-0bc1187e68d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:49.677059 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c966104-a957-42e0-9fa1-0bc1187e68d3 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:49.798278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 415/835] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:49 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:12:49.804595 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47bcc3-4b42-4543-8f9c-68ad4b5aabda None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.825597 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:49.922462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47bcc3-4b42-4543-8f9c-68ad4b5aabda None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:49.962453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ee19-5bde-4fa3-ad24-d0848af6b9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:49.963184 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ee19-5bde-4fa3-ad24-d0848af6b9c5 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.963527 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ee19-5bde-4fa3-ad24-d0848af6b9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.963850 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ee19-5bde-4fa3-ad24-d0848af6b9c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.975694 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080ee19-5bde-4fa3-ad24-d0848af6b9c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:49.977249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080ee19-5bde-4fa3-ad24-d0848af6b9c5 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-4080ee19-5bde-4fa3-ad24-d0848af6b9c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:49.993205 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:49.994518 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:49.995497 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:49.995497 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:49.995497 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:12:49.995497 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 421/836] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:50.001120 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c966104-a957-42e0-9fa1-0bc1187e68d3 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:50.075149 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:50.131215 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c966104-a957-42e0-9fa1-0bc1187e68d3 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.169373 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17751f-3f3e-4969-8281-0f2106dbff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.170105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17751f-3f3e-4969-8281-0f2106dbff0f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.170433 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17751f-3f3e-4969-8281-0f2106dbff0f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.170777 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17751f-3f3e-4969-8281-0f2106dbff0f None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.171770 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17751f-3f3e-4969-8281-0f2106dbff0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:50.172287 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17751f-3f3e-4969-8281-0f2106dbff0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.174756 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17751f-3f3e-4969-8281-0f2106dbff0f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:50.189812 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 416/837] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:50.196569 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ee19-5bde-4fa3-ad24-d0848af6b9c5 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:50.276355 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:50.314186 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ee19-5bde-4fa3-ad24-d0848af6b9c5 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.358643 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e52f6-2efc-40de-913c-e269d307f0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.359777 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e52f6-2efc-40de-913c-e269d307f0d0 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.360212 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e52f6-2efc-40de-913c-e269d307f0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.365523 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e52f6-2efc-40de-913c-e269d307f0d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.370276 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e52f6-2efc-40de-913c-e269d307f0d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.372047 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e52f6-2efc-40de-913c-e269d307f0d0 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-1b4e52f6-2efc-40de-913c-e269d307f0d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:50.385560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:50.386767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:50.387849 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:50.387849 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:50.387849 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:50.387849 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:50.387849 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:50.387849 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:50.387849 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:50.387849 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:12:50.387849 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 422/838] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:50.393408 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17751f-3f3e-4969-8281-0f2106dbff0f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:50.537270 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17751f-3f3e-4969-8281-0f2106dbff0f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.556353 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:50.577255 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28650777-af5d-4ce6-8636-f860fe88783f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.577861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28650777-af5d-4ce6-8636-f860fe88783f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.578173 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28650777-af5d-4ce6-8636-f860fe88783f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.578440 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28650777-af5d-4ce6-8636-f860fe88783f None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.579132 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28650777-af5d-4ce6-8636-f860fe88783f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:50.579431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28650777-af5d-4ce6-8636-f860fe88783f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.580868 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28650777-af5d-4ce6-8636-f860fe88783f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:50.594227 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 417/839] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:50.605007 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e52f6-2efc-40de-913c-e269d307f0d0 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:50.736655 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e52f6-2efc-40de-913c-e269d307f0d0 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.770096 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:50.776485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa8fa3-978d-4373-a86b-b238fd7d0768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.777101 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa8fa3-978d-4373-a86b-b238fd7d0768 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.777368 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa8fa3-978d-4373-a86b-b238fd7d0768 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.777638 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa8fa3-978d-4373-a86b-b238fd7d0768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.778425 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa8fa3-978d-4373-a86b-b238fd7d0768 None admin] RBAC: Adding query filter params (role.id=da50bea8a0ef44dfb668a170a3d0a49a, scope.project.id=ce23217f97fd4906afea681353330615, user.id=19c2519ed2e747e78a2ca91c3625a20d) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:50.779318 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa8fa3-978d-4373-a86b-b238fd7d0768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.781257 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa8fa3-978d-4373-a86b-b238fd7d0768 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:50.797498 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 423/840] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:50 2022] GET /identity/v3/role_assignments?user.id=19c2519ed2e747e78a2ca91c3625a20d&scope.project.id=ce23217f97fd4906afea681353330615&role.id=da50bea8a0ef44dfb668a170a3d0a49a => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:53.159471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25455c90-48fe-4277-9e52-2deb837e6aad None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:53.160259 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25455c90-48fe-4277-9e52-2deb837e6aad None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:53.160450 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25455c90-48fe-4277-9e52-2deb837e6aad None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:53.162670 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 418/841] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:12:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:53.169386 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e8b8d-9eb5-4a63-bff7-2ea375049e4a None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:53.169991 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e8b8d-9eb5-4a63-bff7-2ea375049e4a None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:53.169991 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e8b8d-9eb5-4a63-bff7-2ea375049e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:53.190777 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-836e8b8d-9eb5-4a63-bff7-2ea375049e4a None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:53.192000 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-836e8b8d-9eb5-4a63-bff7-2ea375049e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:53.286403 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 424/842] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:12:53.643087 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25455c90-48fe-4277-9e52-2deb837e6aad None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:53.766271 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25455c90-48fe-4277-9e52-2deb837e6aad None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:53.812805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338535e-9ad8-4329-9228-34fdcbb48b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:53.813579 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338535e-9ad8-4329-9228-34fdcbb48b33 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:53.813912 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338535e-9ad8-4329-9228-34fdcbb48b33 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:53.814304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338535e-9ad8-4329-9228-34fdcbb48b33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:53.831222 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338535e-9ad8-4329-9228-34fdcbb48b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-5338535e-9ad8-4329-9228-34fdcbb48b33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:53.836566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:53.837533 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:12:53.838419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 419/843] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:53.844238 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e8b8d-9eb5-4a63-bff7-2ea375049e4a None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:53.955897 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e8b8d-9eb5-4a63-bff7-2ea375049e4a None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:53.988937 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:54.002734 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42cfa5-a65c-4ca3-a34d-c0dc936b6cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.003404 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42cfa5-a65c-4ca3-a34d-c0dc936b6cfb None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.003684 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42cfa5-a65c-4ca3-a34d-c0dc936b6cfb None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.003958 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42cfa5-a65c-4ca3-a34d-c0dc936b6cfb None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.004633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42cfa5-a65c-4ca3-a34d-c0dc936b6cfb None admin] RBAC: Adding query filter params (name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:54.004933 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42cfa5-a65c-4ca3-a34d-c0dc936b6cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.006341 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42cfa5-a65c-4ca3-a34d-c0dc936b6cfb None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.015235 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 425/844] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:54.022073 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338535e-9ad8-4329-9228-34fdcbb48b33 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.076934 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:54.157736 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338535e-9ad8-4329-9228-34fdcbb48b33 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.200317 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c5d75-eb29-44e3-92bf-9f1bdbcdccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.201407 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c5d75-eb29-44e3-92bf-9f1bdbcdccca None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.201540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c5d75-eb29-44e3-92bf-9f1bdbcdccca None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.201733 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c5d75-eb29-44e3-92bf-9f1bdbcdccca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.217795 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c5d75-eb29-44e3-92bf-9f1bdbcdccca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.219301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c5d75-eb29-44e3-92bf-9f1bdbcdccca None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-c18c5d75-eb29-44e3-92bf-9f1bdbcdccca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:54.238436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:54.240147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:54.241411 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:54.241411 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:54.241411 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:12:54.241411 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 420/845] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:54.246192 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42cfa5-a65c-4ca3-a34d-c0dc936b6cfb None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.395978 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42cfa5-a65c-4ca3-a34d-c0dc936b6cfb None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.441658 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d49c01-6164-48c6-a12a-64fdb9eab660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.442321 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d49c01-6164-48c6-a12a-64fdb9eab660 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.442598 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d49c01-6164-48c6-a12a-64fdb9eab660 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.442872 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d49c01-6164-48c6-a12a-64fdb9eab660 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.443557 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d49c01-6164-48c6-a12a-64fdb9eab660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:54.446045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d49c01-6164-48c6-a12a-64fdb9eab660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.446045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d49c01-6164-48c6-a12a-64fdb9eab660 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.461781 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 426/846] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:54.468276 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c5d75-eb29-44e3-92bf-9f1bdbcdccca None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.591329 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:54.602612 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c5d75-eb29-44e3-92bf-9f1bdbcdccca None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.656356 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b91da4-a780-47a0-b2cd-78e4f7506a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.656902 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b91da4-a780-47a0-b2cd-78e4f7506a7c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.657185 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b91da4-a780-47a0-b2cd-78e4f7506a7c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.657444 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b91da4-a780-47a0-b2cd-78e4f7506a7c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.666948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b91da4-a780-47a0-b2cd-78e4f7506a7c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.668423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b91da4-a780-47a0-b2cd-78e4f7506a7c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-19b91da4-a780-47a0-b2cd-78e4f7506a7c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:54.680799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:54.682184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:54.689895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:54.689895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:54.689895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:54.689895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:54.689895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:54.689895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:54.689895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:54.689895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:54.689895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:12:54.689895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:12:54.689895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 421/847] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:54.690995 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d49c01-6164-48c6-a12a-64fdb9eab660 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.749341 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:54.823975 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d49c01-6164-48c6-a12a-64fdb9eab660 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.869476 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbe806-170c-4a6a-9988-4cd0d9f12f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.870498 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbe806-170c-4a6a-9988-4cd0d9f12f4f None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.870954 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbe806-170c-4a6a-9988-4cd0d9f12f4f None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.871407 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbe806-170c-4a6a-9988-4cd0d9f12f4f None admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.872709 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbe806-170c-4a6a-9988-4cd0d9f12f4f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:54.873295 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbe806-170c-4a6a-9988-4cd0d9f12f4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.875315 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbe806-170c-4a6a-9988-4cd0d9f12f4f None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.905769 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 427/848] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:54.912930 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b91da4-a780-47a0-b2cd-78e4f7506a7c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.031445 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b91da4-a780-47a0-b2cd-78e4f7506a7c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.075810 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e4423-fdc3-480b-93e5-988cd5d497bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.076724 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e4423-fdc3-480b-93e5-988cd5d497bd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.077084 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e4423-fdc3-480b-93e5-988cd5d497bd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.077337 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e4423-fdc3-480b-93e5-988cd5d497bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.094977 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e4423-fdc3-480b-93e5-988cd5d497bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.097372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e4423-fdc3-480b-93e5-988cd5d497bd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-c57e4423-fdc3-480b-93e5-988cd5d497bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:55.113942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:55.120371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:55.121736 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:55.121736 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:55.121736 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:12:55.121736 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 422/849] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:55.122027 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbe806-170c-4a6a-9988-4cd0d9f12f4f None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.252856 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbe806-170c-4a6a-9988-4cd0d9f12f4f None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.255907 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:55.292652 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f943-6f71-48cf-a350-b8f0c7701ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.293264 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f943-6f71-48cf-a350-b8f0c7701ee3 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.293540 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f943-6f71-48cf-a350-b8f0c7701ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.293808 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f943-6f71-48cf-a350-b8f0c7701ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.294496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9f943-6f71-48cf-a350-b8f0c7701ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:55.294805 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9f943-6f71-48cf-a350-b8f0c7701ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.296232 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9f943-6f71-48cf-a350-b8f0c7701ee3 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.309109 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 428/850] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:55.315248 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e4423-fdc3-480b-93e5-988cd5d497bd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.318574 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:55.436355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e4423-fdc3-480b-93e5-988cd5d497bd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.476610 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07114ab0-a495-4901-832f-d6a270e82773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.477319 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07114ab0-a495-4901-832f-d6a270e82773 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.477599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07114ab0-a495-4901-832f-d6a270e82773 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.477896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07114ab0-a495-4901-832f-d6a270e82773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.485943 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07114ab0-a495-4901-832f-d6a270e82773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.487513 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07114ab0-a495-4901-832f-d6a270e82773 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-07114ab0-a495-4901-832f-d6a270e82773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:55.501102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:55.502075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:55.503049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:55.503049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:55.503049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:55.503049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:55.503049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:55.503049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:55.503049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:55.503049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:12:55.503049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 423/851] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:55.508725 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f943-6f71-48cf-a350-b8f0c7701ee3 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.646901 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f943-6f71-48cf-a350-b8f0c7701ee3 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.687587 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d5989-25a6-4873-b985-b37bb2e8df99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.688361 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d5989-25a6-4873-b985-b37bb2e8df99 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.688552 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d5989-25a6-4873-b985-b37bb2e8df99 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.688813 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d5989-25a6-4873-b985-b37bb2e8df99 None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.689667 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d5989-25a6-4873-b985-b37bb2e8df99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:55.689973 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d5989-25a6-4873-b985-b37bb2e8df99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.691860 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d5989-25a6-4873-b985-b37bb2e8df99 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.706368 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 429/852] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:55.712906 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07114ab0-a495-4901-832f-d6a270e82773 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.790235 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:55.836235 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07114ab0-a495-4901-832f-d6a270e82773 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.880422 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0d174-c903-426a-bb98-9e0cb027cc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.881112 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0d174-c903-426a-bb98-9e0cb027cc8a None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.881459 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0d174-c903-426a-bb98-9e0cb027cc8a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.881909 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0d174-c903-426a-bb98-9e0cb027cc8a None admin] PATH_INFO: `/v3/projects/ce23217f97fd4906afea681353330615/users/19c2519ed2e747e78a2ca91c3625a20d/roles/da50bea8a0ef44dfb668a170a3d0a49a` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.901784 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0d174-c903-426a-bb98-9e0cb027cc8a None admin] RBAC: Authorizing `identity:create_grant(project_id=ce23217f97fd4906afea681353330615, user_id=19c2519ed2e747e78a2ca91c3625a20d, role_id=da50bea8a0ef44dfb668a170a3d0a49a)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.903456 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0d174-c903-426a-bb98-9e0cb027cc8a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.917822 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 424/853] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:12:55 2022] PUT /identity/v3/projects/ce23217f97fd4906afea681353330615/users/19c2519ed2e747e78a2ca91c3625a20d/roles/da50bea8a0ef44dfb668a170a3d0a49a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:12:58.336426 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11318462-660b-42ba-8b89-253b12ac7505 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:58.337076 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11318462-660b-42ba-8b89-253b12ac7505 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:58.337076 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11318462-660b-42ba-8b89-253b12ac7505 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:58.338589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 430/854] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:58.344605 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9ddaa-700d-44f1-9fed-860bc204e063 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:58.345118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9ddaa-700d-44f1-9fed-860bc204e063 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:58.345211 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9ddaa-700d-44f1-9fed-860bc204e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:58.366400 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-81e9ddaa-700d-44f1-9fed-860bc204e063 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:58.367678 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-81e9ddaa-700d-44f1-9fed-860bc204e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:58.453010 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 425/855] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:12:58.799691 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11318462-660b-42ba-8b89-253b12ac7505 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:58.841761 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:58.937085 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11318462-660b-42ba-8b89-253b12ac7505 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:58.975740 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef809f-667b-4979-8b18-2dd34702491b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:58.976468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef809f-667b-4979-8b18-2dd34702491b None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:58.976781 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef809f-667b-4979-8b18-2dd34702491b None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:58.977075 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef809f-667b-4979-8b18-2dd34702491b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:58.990668 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef809f-667b-4979-8b18-2dd34702491b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-aeef809f-667b-4979-8b18-2dd34702491b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:58.996245 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:58.998503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:12:58.999411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 431/856] 10.222.0.47 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:59.004106 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9ddaa-700d-44f1-9fed-860bc204e063 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.056887 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:59.139341 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9ddaa-700d-44f1-9fed-860bc204e063 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.187506 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb39e7-94ef-49a2-81b4-730202c86399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:59.188283 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb39e7-94ef-49a2-81b4-730202c86399 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.188556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb39e7-94ef-49a2-81b4-730202c86399 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.188826 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb39e7-94ef-49a2-81b4-730202c86399 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.189602 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb39e7-94ef-49a2-81b4-730202c86399 None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:59.189807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb39e7-94ef-49a2-81b4-730202c86399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:59.191303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb39e7-94ef-49a2-81b4-730202c86399 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:59.201771 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 426/857] 10.222.0.47 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:59.208092 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef809f-667b-4979-8b18-2dd34702491b None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.327952 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:59.351706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef809f-667b-4979-8b18-2dd34702491b None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.396712 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8bc34-5e3e-4f67-9e99-fdc9fa4fbae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:59.397354 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8bc34-5e3e-4f67-9e99-fdc9fa4fbae0 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.397692 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8bc34-5e3e-4f67-9e99-fdc9fa4fbae0 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.398038 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8bc34-5e3e-4f67-9e99-fdc9fa4fbae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.409412 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8bc34-5e3e-4f67-9e99-fdc9fa4fbae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:59.411033 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8bc34-5e3e-4f67-9e99-fdc9fa4fbae0 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-42c8bc34-5e3e-4f67-9e99-fdc9fa4fbae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:59.429177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:59.430346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:59.431384 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:59.431384 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:59.431384 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:12:59.431384 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 432/858] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:59.437915 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb39e7-94ef-49a2-81b4-730202c86399 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.577144 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb39e7-94ef-49a2-81b4-730202c86399 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.580093 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:59.616737 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e221007-65a2-4f74-8cce-ae9dc6c1b96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:59.617345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e221007-65a2-4f74-8cce-ae9dc6c1b96c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.617614 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e221007-65a2-4f74-8cce-ae9dc6c1b96c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.617876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e221007-65a2-4f74-8cce-ae9dc6c1b96c None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.618557 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e221007-65a2-4f74-8cce-ae9dc6c1b96c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:59.618853 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e221007-65a2-4f74-8cce-ae9dc6c1b96c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:59.620213 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e221007-65a2-4f74-8cce-ae9dc6c1b96c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:59.648303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 427/859] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:59.649688 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8bc34-5e3e-4f67-9e99-fdc9fa4fbae0 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.774670 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8bc34-5e3e-4f67-9e99-fdc9fa4fbae0 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.813896 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f653e-f6ae-415e-9644-b5db102a6c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:59.814553 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f653e-f6ae-415e-9644-b5db102a6c45 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.814829 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f653e-f6ae-415e-9644-b5db102a6c45 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.815191 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f653e-f6ae-415e-9644-b5db102a6c45 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.818694 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:59.825078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f653e-f6ae-415e-9644-b5db102a6c45 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:59.827425 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f653e-f6ae-415e-9644-b5db102a6c45 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-304f653e-f6ae-415e-9644-b5db102a6c45 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:59.841072 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:59.843097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:59.844277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:59.844277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:59.844277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:59.844277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:59.844277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:59.844277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:59.844277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:59.844277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:59.844277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:12:59.844277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:12:59.844277 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 433/860] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:59.854297 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e221007-65a2-4f74-8cce-ae9dc6c1b96c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.978224 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e221007-65a2-4f74-8cce-ae9dc6c1b96c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.025679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95073-a431-46bb-9e55-deca16837997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.026279 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95073-a431-46bb-9e55-deca16837997 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.026536 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95073-a431-46bb-9e55-deca16837997 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.026798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95073-a431-46bb-9e55-deca16837997 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.027730 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95073-a431-46bb-9e55-deca16837997 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:00.028065 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95073-a431-46bb-9e55-deca16837997 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.029706 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95073-a431-46bb-9e55-deca16837997 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.060110 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 428/861] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:00.062114 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f653e-f6ae-415e-9644-b5db102a6c45 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:00.209328 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f653e-f6ae-415e-9644-b5db102a6c45 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.255342 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dc1ef-d416-4aee-8c05-6bdae9c41d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.256335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dc1ef-d416-4aee-8c05-6bdae9c41d73 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.256766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dc1ef-d416-4aee-8c05-6bdae9c41d73 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.257202 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dc1ef-d416-4aee-8c05-6bdae9c41d73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.332893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:00.342190 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dc1ef-d416-4aee-8c05-6bdae9c41d73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.344155 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dc1ef-d416-4aee-8c05-6bdae9c41d73 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.476401 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 434/862] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:00 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:13:00.482890 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95073-a431-46bb-9e55-deca16837997 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:00.521178 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:00.635174 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95073-a431-46bb-9e55-deca16837997 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.680166 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438ae67-ca31-4280-b5ec-3b3f8bbde411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.680890 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438ae67-ca31-4280-b5ec-3b3f8bbde411 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.681158 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438ae67-ca31-4280-b5ec-3b3f8bbde411 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.681446 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438ae67-ca31-4280-b5ec-3b3f8bbde411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.694093 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438ae67-ca31-4280-b5ec-3b3f8bbde411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.695593 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438ae67-ca31-4280-b5ec-3b3f8bbde411 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-a438ae67-ca31-4280-b5ec-3b3f8bbde411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:00.712262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:00.714360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:00.716104 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:00.716104 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:00.716104 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:00.716104 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 429/863] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:00.720144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dc1ef-d416-4aee-8c05-6bdae9c41d73 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:00.835801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:00.844274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dc1ef-d416-4aee-8c05-6bdae9c41d73 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.887641 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763a5ef-7f42-4b08-a82f-25dcff661272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.888255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763a5ef-7f42-4b08-a82f-25dcff661272 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.888603 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763a5ef-7f42-4b08-a82f-25dcff661272 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.888865 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763a5ef-7f42-4b08-a82f-25dcff661272 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.889537 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763a5ef-7f42-4b08-a82f-25dcff661272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:00.889925 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763a5ef-7f42-4b08-a82f-25dcff661272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.891338 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763a5ef-7f42-4b08-a82f-25dcff661272 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.904963 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 435/864] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:00.911420 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438ae67-ca31-4280-b5ec-3b3f8bbde411 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:01.000624 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:01.031280 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438ae67-ca31-4280-b5ec-3b3f8bbde411 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:01.083877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d636206-6d71-4066-80f3-2e9455d00309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:01.084730 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d636206-6d71-4066-80f3-2e9455d00309 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:01.085121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d636206-6d71-4066-80f3-2e9455d00309 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:01.085561 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d636206-6d71-4066-80f3-2e9455d00309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.096505 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d636206-6d71-4066-80f3-2e9455d00309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:01.098382 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d636206-6d71-4066-80f3-2e9455d00309 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-8d636206-6d71-4066-80f3-2e9455d00309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:01.114483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:01.115523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:01.116657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:01.116657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:01.116657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:01.116657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:01.116657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:01.116657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:01.116657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:01.116657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:01.116657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 430/865] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:01.123037 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763a5ef-7f42-4b08-a82f-25dcff661272 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:01.238765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763a5ef-7f42-4b08-a82f-25dcff661272 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:01.277959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7774-67ae-4c75-bb49-bdd43bc78e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:01.278897 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7774-67ae-4c75-bb49-bdd43bc78e82 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:01.279248 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7774-67ae-4c75-bb49-bdd43bc78e82 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:01.279500 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7774-67ae-4c75-bb49-bdd43bc78e82 None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.280214 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7774-67ae-4c75-bb49-bdd43bc78e82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:01.280503 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7774-67ae-4c75-bb49-bdd43bc78e82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:01.281957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7774-67ae-4c75-bb49-bdd43bc78e82 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:01.296265 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 436/866] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:01.303656 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d636206-6d71-4066-80f3-2e9455d00309 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:01.421550 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d636206-6d71-4066-80f3-2e9455d00309 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:01.465205 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef1849-258b-489b-900c-98e8dd896b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:01.465856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef1849-258b-489b-900c-98e8dd896b4c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:01.466166 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef1849-258b-489b-900c-98e8dd896b4c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:01.466434 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef1849-258b-489b-900c-98e8dd896b4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.467371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef1849-258b-489b-900c-98e8dd896b4c None admin] RBAC: Adding query filter params (role.id=da50bea8a0ef44dfb668a170a3d0a49a, scope.project.id=ce23217f97fd4906afea681353330615, user.id=19c2519ed2e747e78a2ca91c3625a20d) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:01.467775 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef1849-258b-489b-900c-98e8dd896b4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:01.469389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef1849-258b-489b-900c-98e8dd896b4c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:01.471759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:01.480575 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 431/867] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:01 2022] GET /identity/v3/role_assignments?user.id=19c2519ed2e747e78a2ca91c3625a20d&scope.project.id=ce23217f97fd4906afea681353330615&role.id=da50bea8a0ef44dfb668a170a3d0a49a => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:03.949169 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385737d-88c5-4672-aee7-de90db65042c None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:03.949787 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385737d-88c5-4672-aee7-de90db65042c None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:03.950121 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385737d-88c5-4672-aee7-de90db65042c None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:03.952465 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 437/868] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:13:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:03.958621 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3d744-1012-4de7-a949-eca8c4aa9962 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:03.959174 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3d744-1012-4de7-a949-eca8c4aa9962 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:03.959174 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3d744-1012-4de7-a949-eca8c4aa9962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:03.977941 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-e6b3d744-1012-4de7-a949-eca8c4aa9962 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:03.979201 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-e6b3d744-1012-4de7-a949-eca8c4aa9962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:04.061796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 432/869] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:04.400755 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385737d-88c5-4672-aee7-de90db65042c None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:04.427797 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:04.534872 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385737d-88c5-4672-aee7-de90db65042c None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:04.580513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbae150-8207-4614-93d5-d9b6dafdd4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:04.581177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbae150-8207-4614-93d5-d9b6dafdd4e0 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:04.581733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbae150-8207-4614-93d5-d9b6dafdd4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:04.582118 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbae150-8207-4614-93d5-d9b6dafdd4e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:04.597715 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbae150-8207-4614-93d5-d9b6dafdd4e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-9bbae150-8207-4614-93d5-d9b6dafdd4e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:04.602618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:04.603893 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:13:04.604832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 438/870] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:13:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:04.610932 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3d744-1012-4de7-a949-eca8c4aa9962 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:04.734851 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3d744-1012-4de7-a949-eca8c4aa9962 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:04.765947 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:04.774784 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c51ca-cd26-463c-bd9b-119dce032c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:04.775402 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c51ca-cd26-463c-bd9b-119dce032c42 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:04.775679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c51ca-cd26-463c-bd9b-119dce032c42 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:04.775951 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c51ca-cd26-463c-bd9b-119dce032c42 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:04.776627 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c51ca-cd26-463c-bd9b-119dce032c42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:04.776929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c51ca-cd26-463c-bd9b-119dce032c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:04.778359 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c51ca-cd26-463c-bd9b-119dce032c42 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:04.787917 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 433/871] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:13:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:04.794601 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbae150-8207-4614-93d5-d9b6dafdd4e0 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:04.897911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:04.929755 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbae150-8207-4614-93d5-d9b6dafdd4e0 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:04.972485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3f410-cdf1-43ed-a112-94e545ecdf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:04.973490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3f410-cdf1-43ed-a112-94e545ecdf93 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:04.973928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3f410-cdf1-43ed-a112-94e545ecdf93 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:04.974403 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3f410-cdf1-43ed-a112-94e545ecdf93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:04.992619 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3f410-cdf1-43ed-a112-94e545ecdf93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:04.994011 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3f410-cdf1-43ed-a112-94e545ecdf93 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-efe3f410-cdf1-43ed-a112-94e545ecdf93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:05.010840 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:05.018402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:05.019299 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:05.019299 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:05.019299 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:13:05.019299 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 439/872] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:05.020126 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c51ca-cd26-463c-bd9b-119dce032c42 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.165322 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c51ca-cd26-463c-bd9b-119dce032c42 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.210778 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51f179-7a78-4943-9043-e3c7314b9376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.211421 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51f179-7a78-4943-9043-e3c7314b9376 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.211722 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51f179-7a78-4943-9043-e3c7314b9376 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.211992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51f179-7a78-4943-9043-e3c7314b9376 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.212660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51f179-7a78-4943-9043-e3c7314b9376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:05.213038 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51f179-7a78-4943-9043-e3c7314b9376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.214501 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51f179-7a78-4943-9043-e3c7314b9376 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.227538 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 434/873] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:05.233468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3f410-cdf1-43ed-a112-94e545ecdf93 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.348267 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3f410-cdf1-43ed-a112-94e545ecdf93 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.381275 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:05.393004 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ef712-0149-4211-9853-35fd29a24a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.394732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ef712-0149-4211-9853-35fd29a24a86 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.394732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ef712-0149-4211-9853-35fd29a24a86 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.394732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ef712-0149-4211-9853-35fd29a24a86 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.403485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ef712-0149-4211-9853-35fd29a24a86 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.411640 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ef712-0149-4211-9853-35fd29a24a86 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-595ef712-0149-4211-9853-35fd29a24a86 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:13:05.417589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:05.418693 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:05.419690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:05.419690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:05.419690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:13:05.419690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:13:05.419690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:13:05.419690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:13:05.419690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:13:05.419690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:13:05.419690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:13:05.419690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:13:05.419690 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 440/874] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:05.425729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51f179-7a78-4943-9043-e3c7314b9376 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.484651 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:05.548263 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51f179-7a78-4943-9043-e3c7314b9376 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.590088 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fa87b-0f24-49a5-abe5-276e6269e801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.591014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fa87b-0f24-49a5-abe5-276e6269e801 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.591345 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fa87b-0f24-49a5-abe5-276e6269e801 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.591644 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fa87b-0f24-49a5-abe5-276e6269e801 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.592478 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fa87b-0f24-49a5-abe5-276e6269e801 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:05.592798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fa87b-0f24-49a5-abe5-276e6269e801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.594536 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fa87b-0f24-49a5-abe5-276e6269e801 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.620812 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 435/875] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:05.622649 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ef712-0149-4211-9853-35fd29a24a86 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.774126 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ef712-0149-4211-9853-35fd29a24a86 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.830365 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184ea1d-e495-4d11-b027-e1cecc73d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.831351 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184ea1d-e495-4d11-b027-e1cecc73d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.831815 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184ea1d-e495-4d11-b027-e1cecc73d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.832280 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184ea1d-e495-4d11-b027-e1cecc73d4f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.907915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:05.924416 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184ea1d-e495-4d11-b027-e1cecc73d4f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.926090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184ea1d-e495-4d11-b027-e1cecc73d4f8 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:06.056262 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 441/876] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:13:06.064798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fa87b-0f24-49a5-abe5-276e6269e801 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.196282 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fa87b-0f24-49a5-abe5-276e6269e801 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:06.207699 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:06.246699 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248515e-f3db-4379-ad09-f1c0ef3c9a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:06.247395 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248515e-f3db-4379-ad09-f1c0ef3c9a18 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:06.247665 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248515e-f3db-4379-ad09-f1c0ef3c9a18 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:06.248001 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248515e-f3db-4379-ad09-f1c0ef3c9a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:06.263169 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248515e-f3db-4379-ad09-f1c0ef3c9a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:06.265625 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248515e-f3db-4379-ad09-f1c0ef3c9a18 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-c248515e-f3db-4379-ad09-f1c0ef3c9a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:06.283993 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:06.285546 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:06.286864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:06.286864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:06.286864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:06.286864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 436/877] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:06.293897 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184ea1d-e495-4d11-b027-e1cecc73d4f8 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.408798 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:06.428450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184ea1d-e495-4d11-b027-e1cecc73d4f8 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:06.469794 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d999d-8745-420d-b6a7-b5ee394ead15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:06.470524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d999d-8745-420d-b6a7-b5ee394ead15 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:06.470803 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d999d-8745-420d-b6a7-b5ee394ead15 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:06.471147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d999d-8745-420d-b6a7-b5ee394ead15 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:06.471827 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d999d-8745-420d-b6a7-b5ee394ead15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:06.472120 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d999d-8745-420d-b6a7-b5ee394ead15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:06.473514 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d999d-8745-420d-b6a7-b5ee394ead15 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:06.488870 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 442/878] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:06.494718 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248515e-f3db-4379-ad09-f1c0ef3c9a18 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.627750 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248515e-f3db-4379-ad09-f1c0ef3c9a18 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:06.669713 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac0b9e-df7c-4f23-8803-5e44c2b02681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:06.670905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac0b9e-df7c-4f23-8803-5e44c2b02681 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:06.671234 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac0b9e-df7c-4f23-8803-5e44c2b02681 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:06.671672 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac0b9e-df7c-4f23-8803-5e44c2b02681 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:06.679929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac0b9e-df7c-4f23-8803-5e44c2b02681 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:06.681508 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac0b9e-df7c-4f23-8803-5e44c2b02681 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-f4ac0b9e-df7c-4f23-8803-5e44c2b02681 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:06.694043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:06.695040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:06.696159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:06.696159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:06.696159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:06.696159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:06.696159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:06.696159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:06.696159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:06.696159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:06.696159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 437/879] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:06.701868 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d999d-8745-420d-b6a7-b5ee394ead15 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.833284 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d999d-8745-420d-b6a7-b5ee394ead15 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:06.880264 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f2f24-c4f0-450a-a3b9-3f8f8e0d5b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:06.880889 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2f24-c4f0-450a-a3b9-3f8f8e0d5b82 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:06.881158 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2f24-c4f0-450a-a3b9-3f8f8e0d5b82 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:06.881442 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2f24-c4f0-450a-a3b9-3f8f8e0d5b82 None admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:06.882177 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f2f24-c4f0-450a-a3b9-3f8f8e0d5b82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:06.882474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f2f24-c4f0-450a-a3b9-3f8f8e0d5b82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:06.884026 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f2f24-c4f0-450a-a3b9-3f8f8e0d5b82 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:06.897980 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 443/880] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:06.904740 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac0b9e-df7c-4f23-8803-5e44c2b02681 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.931721 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:07.036101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac0b9e-df7c-4f23-8803-5e44c2b02681 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:07.089609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e21b1e-c9d4-4e89-9b44-610298ba6b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:07.090989 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e21b1e-c9d4-4e89-9b44-610298ba6b4e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:07.090989 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e21b1e-c9d4-4e89-9b44-610298ba6b4e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:07.090989 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e21b1e-c9d4-4e89-9b44-610298ba6b4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:07.091505 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e21b1e-c9d4-4e89-9b44-610298ba6b4e None admin] RBAC: Adding query filter params (role.id=5756384fa8d842139e2f1fc44c5088bd, scope.project.id=ce23217f97fd4906afea681353330615, user.id=19c2519ed2e747e78a2ca91c3625a20d) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:07.091825 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e21b1e-c9d4-4e89-9b44-610298ba6b4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:07.093677 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e21b1e-c9d4-4e89-9b44-610298ba6b4e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:07.103151 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 438/881] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:06 2022] GET /identity/v3/role_assignments?user.id=19c2519ed2e747e78a2ca91c3625a20d&scope.project.id=ce23217f97fd4906afea681353330615&role.id=5756384fa8d842139e2f1fc44c5088bd => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:09.341278 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39710b-fc83-4cb7-ab44-4a293b9495d9 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.341889 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39710b-fc83-4cb7-ab44-4a293b9495d9 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.341889 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39710b-fc83-4cb7-ab44-4a293b9495d9 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.343144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 444/882] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:09.348879 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e40e00-a0cd-4f1b-a602-e9631cf71663 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.349599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e40e00-a0cd-4f1b-a602-e9631cf71663 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.349718 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e40e00-a0cd-4f1b-a602-e9631cf71663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.372121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-e7e40e00-a0cd-4f1b-a602-e9631cf71663 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:09.373337 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-e7e40e00-a0cd-4f1b-a602-e9631cf71663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:09.447421 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 439/883] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:09 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:09.764697 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39710b-fc83-4cb7-ab44-4a293b9495d9 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:09.781356 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:09.884275 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39710b-fc83-4cb7-ab44-4a293b9495d9 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:09.920672 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a974ddf-47b5-4a9b-9fe8-2e3a9bcef8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:09.921298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a974ddf-47b5-4a9b-9fe8-2e3a9bcef8f8 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.921576 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a974ddf-47b5-4a9b-9fe8-2e3a9bcef8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.921848 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a974ddf-47b5-4a9b-9fe8-2e3a9bcef8f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.932111 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a974ddf-47b5-4a9b-9fe8-2e3a9bcef8f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-0a974ddf-47b5-4a9b-9fe8-2e3a9bcef8f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:09.936941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:09.937938 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:13:09.938830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 445/884] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:13:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:09.944363 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e40e00-a0cd-4f1b-a602-e9631cf71663 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:09.961153 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:10.061255 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e40e00-a0cd-4f1b-a602-e9631cf71663 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.102498 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c440381-5acd-4925-99de-1884a135b55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.103135 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c440381-5acd-4925-99de-1884a135b55c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.103437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c440381-5acd-4925-99de-1884a135b55c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.103722 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c440381-5acd-4925-99de-1884a135b55c None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.104478 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c440381-5acd-4925-99de-1884a135b55c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:10.104815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c440381-5acd-4925-99de-1884a135b55c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.106423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c440381-5acd-4925-99de-1884a135b55c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.116094 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 440/885] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:10.122745 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a974ddf-47b5-4a9b-9fe8-2e3a9bcef8f8 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.203642 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:10.239812 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a974ddf-47b5-4a9b-9fe8-2e3a9bcef8f8 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.292600 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa207aa-31f9-41c2-a0e9-e2e734a95afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.293505 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa207aa-31f9-41c2-a0e9-e2e734a95afa None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.293788 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa207aa-31f9-41c2-a0e9-e2e734a95afa None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.294046 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa207aa-31f9-41c2-a0e9-e2e734a95afa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.310834 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa207aa-31f9-41c2-a0e9-e2e734a95afa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.312371 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa207aa-31f9-41c2-a0e9-e2e734a95afa None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-4aa207aa-31f9-41c2-a0e9-e2e734a95afa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:10.329003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:10.330379 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:10.331455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:10.331455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:10.331455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:13:10.331455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 446/886] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:10.336305 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c440381-5acd-4925-99de-1884a135b55c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.430808 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:10.454310 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c440381-5acd-4925-99de-1884a135b55c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.490719 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2af1d9-1080-4a30-a766-7cf4760eebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.491312 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2af1d9-1080-4a30-a766-7cf4760eebfa None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.491583 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2af1d9-1080-4a30-a766-7cf4760eebfa None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.491849 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2af1d9-1080-4a30-a766-7cf4760eebfa None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.492485 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2af1d9-1080-4a30-a766-7cf4760eebfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:10.492814 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2af1d9-1080-4a30-a766-7cf4760eebfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.494212 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2af1d9-1080-4a30-a766-7cf4760eebfa None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.506940 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 441/887] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:10.513035 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa207aa-31f9-41c2-a0e9-e2e734a95afa None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.633801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa207aa-31f9-41c2-a0e9-e2e734a95afa None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.674252 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:10.691901 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8032b5-e4f9-40cf-b028-487d43bad77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.692536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8032b5-e4f9-40cf-b028-487d43bad77a None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.692809 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8032b5-e4f9-40cf-b028-487d43bad77a None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.693078 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8032b5-e4f9-40cf-b028-487d43bad77a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.703025 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8032b5-e4f9-40cf-b028-487d43bad77a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.704460 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8032b5-e4f9-40cf-b028-487d43bad77a None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-7a8032b5-e4f9-40cf-b028-487d43bad77a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:13:10.716193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:10.717364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:10.719223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:10.719223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:10.719223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:13:10.719223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:13:10.719223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:13:10.719223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:13:10.719223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:13:10.719223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:13:10.719223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:13:10.719223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:13:10.719223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 447/888] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:10.725061 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2af1d9-1080-4a30-a766-7cf4760eebfa None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.841594 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2af1d9-1080-4a30-a766-7cf4760eebfa None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.877391 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c2e77-d4aa-43d1-91f6-68a386720a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.877991 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c2e77-d4aa-43d1-91f6-68a386720a5f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.878278 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c2e77-d4aa-43d1-91f6-68a386720a5f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.878542 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c2e77-d4aa-43d1-91f6-68a386720a5f None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.879258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c2e77-d4aa-43d1-91f6-68a386720a5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:10.879553 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c2e77-d4aa-43d1-91f6-68a386720a5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.881000 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c2e77-d4aa-43d1-91f6-68a386720a5f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.883648 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:10.899646 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 442/889] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:10.905725 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8032b5-e4f9-40cf-b028-487d43bad77a None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.023049 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8032b5-e4f9-40cf-b028-487d43bad77a None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.065077 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1119fb-4177-4f91-95f0-b3796241c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.065956 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1119fb-4177-4f91-95f0-b3796241c0cc None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.066383 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1119fb-4177-4f91-95f0-b3796241c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.066775 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1119fb-4177-4f91-95f0-b3796241c0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.084464 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1119fb-4177-4f91-95f0-b3796241c0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.086139 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1119fb-4177-4f91-95f0-b3796241c0cc None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-8b1119fb-4177-4f91-95f0-b3796241c0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:11.101820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:11.102987 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:11.103997 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:11.103997 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:11.103997 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:13:11.103997 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 448/890] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:11.113155 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c2e77-d4aa-43d1-91f6-68a386720a5f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.224500 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c2e77-d4aa-43d1-91f6-68a386720a5f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.259156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bbe61-f6ff-430b-8bf6-4449dc303392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.259760 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bbe61-f6ff-430b-8bf6-4449dc303392 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.260030 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bbe61-f6ff-430b-8bf6-4449dc303392 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.260294 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bbe61-f6ff-430b-8bf6-4449dc303392 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.260929 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bbe61-f6ff-430b-8bf6-4449dc303392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:11.261218 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bbe61-f6ff-430b-8bf6-4449dc303392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.262604 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bbe61-f6ff-430b-8bf6-4449dc303392 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.273804 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 443/891] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:11.280031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1119fb-4177-4f91-95f0-b3796241c0cc None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.316104 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:11.402966 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1119fb-4177-4f91-95f0-b3796241c0cc None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.440485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d0866-eeb0-4a5a-b4d6-773a4f2cb153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.441116 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d0866-eeb0-4a5a-b4d6-773a4f2cb153 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.441393 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d0866-eeb0-4a5a-b4d6-773a4f2cb153 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.441667 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d0866-eeb0-4a5a-b4d6-773a4f2cb153 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.449082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d0866-eeb0-4a5a-b4d6-773a4f2cb153 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.450560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d0866-eeb0-4a5a-b4d6-773a4f2cb153 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-257d0866-eeb0-4a5a-b4d6-773a4f2cb153 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:11.461918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:11.463352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:11.465012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:11.465012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:11.465012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:11.465012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:11.465012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:11.465012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:11.465012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:11.465012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:13:11.465012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 449/892] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:11.471451 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bbe61-f6ff-430b-8bf6-4449dc303392 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.534480 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:11.585686 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bbe61-f6ff-430b-8bf6-4449dc303392 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.624661 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611309a7-52ac-43cd-8742-05a7e4a32a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.625267 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611309a7-52ac-43cd-8742-05a7e4a32a97 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.625572 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611309a7-52ac-43cd-8742-05a7e4a32a97 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.625841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611309a7-52ac-43cd-8742-05a7e4a32a97 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.626574 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611309a7-52ac-43cd-8742-05a7e4a32a97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:11.626881 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611309a7-52ac-43cd-8742-05a7e4a32a97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.628326 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611309a7-52ac-43cd-8742-05a7e4a32a97 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.641708 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 444/893] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:13:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:11.648699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d0866-eeb0-4a5a-b4d6-773a4f2cb153 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.756830 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:11.766842 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d0866-eeb0-4a5a-b4d6-773a4f2cb153 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.810878 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796de385-a2fe-447e-abcb-56369500ca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.811543 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796de385-a2fe-447e-abcb-56369500ca46 None admin] REQUEST_METHOD: `PUT` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.811820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796de385-a2fe-447e-abcb-56369500ca46 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.812094 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796de385-a2fe-447e-abcb-56369500ca46 None admin] PATH_INFO: `/v3/projects/ce23217f97fd4906afea681353330615/users/19c2519ed2e747e78a2ca91c3625a20d/roles/5756384fa8d842139e2f1fc44c5088bd` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.814185 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796de385-a2fe-447e-abcb-56369500ca46 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce23217f97fd4906afea681353330615, user_id=19c2519ed2e747e78a2ca91c3625a20d, role_id=5756384fa8d842139e2f1fc44c5088bd)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.815635 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796de385-a2fe-447e-abcb-56369500ca46 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.831955 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 450/894] 10.222.0.47 () {58 vars in 1439 bytes} [Tue Aug 23 16:13:11 2022] PUT /identity/v3/projects/ce23217f97fd4906afea681353330615/users/19c2519ed2e747e78a2ca91c3625a20d/roles/5756384fa8d842139e2f1fc44c5088bd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:13:14.035885 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab82a9-e36b-4d6d-b4fd-7369abe5b6b2 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.036456 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab82a9-e36b-4d6d-b4fd-7369abe5b6b2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.036456 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab82a9-e36b-4d6d-b4fd-7369abe5b6b2 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.037766 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 445/895] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:14.043933 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46879620-f778-4722-ba08-1f0e158e9bc3 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.044427 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46879620-f778-4722-ba08-1f0e158e9bc3 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.044427 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46879620-f778-4722-ba08-1f0e158e9bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.068723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-46879620-f778-4722-ba08-1f0e158e9bc3 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:14.070028 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-46879620-f778-4722-ba08-1f0e158e9bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:14.149545 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 451/896] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:14 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:14.473613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab82a9-e36b-4d6d-b4fd-7369abe5b6b2 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:14.589424 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab82a9-e36b-4d6d-b4fd-7369abe5b6b2 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:14.606944 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:14.628131 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd833be4-5af6-4609-8b20-b6f81ac6c956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:14.628736 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd833be4-5af6-4609-8b20-b6f81ac6c956 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.629004 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd833be4-5af6-4609-8b20-b6f81ac6c956 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.629297 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd833be4-5af6-4609-8b20-b6f81ac6c956 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.639903 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd833be4-5af6-4609-8b20-b6f81ac6c956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-dd833be4-5af6-4609-8b20-b6f81ac6c956 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:14.644642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:14.645763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:14.647077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 446/897] 10.222.0.47 () {56 vars in 1096 bytes} [Tue Aug 23 16:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:14.653431 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46879620-f778-4722-ba08-1f0e158e9bc3 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:14.740821 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:14.762613 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46879620-f778-4722-ba08-1f0e158e9bc3 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:14.800371 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992610-4e35-416a-8e42-ebcb01af78d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:14.800975 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992610-4e35-416a-8e42-ebcb01af78d1 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.802261 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992610-4e35-416a-8e42-ebcb01af78d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.802261 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992610-4e35-416a-8e42-ebcb01af78d1 None admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.802261 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992610-4e35-416a-8e42-ebcb01af78d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:14.802560 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992610-4e35-416a-8e42-ebcb01af78d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:14.803846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992610-4e35-416a-8e42-ebcb01af78d1 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:14.812597 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 452/898] 10.222.0.47 () {56 vars in 1099 bytes} [Tue Aug 23 16:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:14.819282 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd833be4-5af6-4609-8b20-b6f81ac6c956 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:14.937946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd833be4-5af6-4609-8b20-b6f81ac6c956 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:14.976219 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793bbb-aecf-46ea-82c3-4219780b7a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:14.976808 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793bbb-aecf-46ea-82c3-4219780b7a7a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.977111 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793bbb-aecf-46ea-82c3-4219780b7a7a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.977379 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793bbb-aecf-46ea-82c3-4219780b7a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.989198 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90793bbb-aecf-46ea-82c3-4219780b7a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:14.990672 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90793bbb-aecf-46ea-82c3-4219780b7a7a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-90793bbb-aecf-46ea-82c3-4219780b7a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:15.005667 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:15.006774 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:15.007710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:15.007710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:15.007710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:15.007710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 447/899] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:15.013132 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992610-4e35-416a-8e42-ebcb01af78d1 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.131049 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992610-4e35-416a-8e42-ebcb01af78d1 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.167823 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6072d-2254-4dde-a1fe-327373a2b5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.168469 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6072d-2254-4dde-a1fe-327373a2b5b8 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.168744 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6072d-2254-4dde-a1fe-327373a2b5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.169016 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6072d-2254-4dde-a1fe-327373a2b5b8 None admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.169706 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6072d-2254-4dde-a1fe-327373a2b5b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:15.170053 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6072d-2254-4dde-a1fe-327373a2b5b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:15.171435 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6072d-2254-4dde-a1fe-327373a2b5b8 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.184512 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 453/900] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:15.190800 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793bbb-aecf-46ea-82c3-4219780b7a7a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.227373 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:15.316490 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793bbb-aecf-46ea-82c3-4219780b7a7a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.354791 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07747e-4616-4352-9f6a-d56aea4004f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.355930 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07747e-4616-4352-9f6a-d56aea4004f1 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.355930 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07747e-4616-4352-9f6a-d56aea4004f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.355930 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07747e-4616-4352-9f6a-d56aea4004f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.368873 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07747e-4616-4352-9f6a-d56aea4004f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:15.371253 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07747e-4616-4352-9f6a-d56aea4004f1 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-4f07747e-4616-4352-9f6a-d56aea4004f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:13:15.389471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:15.390660 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:15.391599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:15.391599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:15.391599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:13:15.391599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:13:15.391599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:13:15.391599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:13:15.391599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:13:15.391599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:13:15.391599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:13:15.391599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:15.391599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 448/901] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:15.397399 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6072d-2254-4dde-a1fe-327373a2b5b8 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.402879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:15.520701 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6072d-2254-4dde-a1fe-327373a2b5b8 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.557214 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e41a28-90fe-4ae3-9bf1-1efc7ccc1f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.557819 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e41a28-90fe-4ae3-9bf1-1efc7ccc1f47 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.558125 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e41a28-90fe-4ae3-9bf1-1efc7ccc1f47 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.558431 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e41a28-90fe-4ae3-9bf1-1efc7ccc1f47 None admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.559149 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e41a28-90fe-4ae3-9bf1-1efc7ccc1f47 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:15.559446 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e41a28-90fe-4ae3-9bf1-1efc7ccc1f47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:15.560910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e41a28-90fe-4ae3-9bf1-1efc7ccc1f47 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.578120 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 454/902] 10.222.0.47 () {56 vars in 1143 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:15.584152 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07747e-4616-4352-9f6a-d56aea4004f1 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.679666 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:15.697690 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07747e-4616-4352-9f6a-d56aea4004f1 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.734447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11ae9-cb2f-4f22-9c09-f16b3694a163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.735043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11ae9-cb2f-4f22-9c09-f16b3694a163 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.735320 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11ae9-cb2f-4f22-9c09-f16b3694a163 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.735584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11ae9-cb2f-4f22-9c09-f16b3694a163 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.807704 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d11ae9-cb2f-4f22-9c09-f16b3694a163 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:15.809317 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d11ae9-cb2f-4f22-9c09-f16b3694a163 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.908454 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:15.925857 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 449/903] 10.222.0.47 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:13:15.934691 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e41a28-90fe-4ae3-9bf1-1efc7ccc1f47 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:16.000632 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:16.040712 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e41a28-90fe-4ae3-9bf1-1efc7ccc1f47 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.090445 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38c9c4-59c2-4be3-8a9a-1734908ad29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:16.091228 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38c9c4-59c2-4be3-8a9a-1734908ad29a None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.091484 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38c9c4-59c2-4be3-8a9a-1734908ad29a None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.091778 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38c9c4-59c2-4be3-8a9a-1734908ad29a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.105331 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38c9c4-59c2-4be3-8a9a-1734908ad29a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.106888 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38c9c4-59c2-4be3-8a9a-1734908ad29a None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-db38c9c4-59c2-4be3-8a9a-1734908ad29a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:16.122959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:16.124586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:16.126032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:16.126032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:16.126032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:13:16.126032 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 455/904] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:16.130092 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11ae9-cb2f-4f22-9c09-f16b3694a163 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:16.234320 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11ae9-cb2f-4f22-9c09-f16b3694a163 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.270779 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2efe9-bce4-4aba-9a5b-2ed80fba785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:16.271383 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2efe9-bce4-4aba-9a5b-2ed80fba785c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.271657 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2efe9-bce4-4aba-9a5b-2ed80fba785c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.271924 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2efe9-bce4-4aba-9a5b-2ed80fba785c None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.272556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2efe9-bce4-4aba-9a5b-2ed80fba785c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:16.272853 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2efe9-bce4-4aba-9a5b-2ed80fba785c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.274247 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2efe9-bce4-4aba-9a5b-2ed80fba785c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.285958 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 450/905] 10.222.0.47 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:16.292837 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38c9c4-59c2-4be3-8a9a-1734908ad29a None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:16.398868 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38c9c4-59c2-4be3-8a9a-1734908ad29a None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.413358 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:16.436413 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7fd39-1cb5-4e69-a3c6-0df85bbf1f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:16.437084 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7fd39-1cb5-4e69-a3c6-0df85bbf1f49 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.437364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7fd39-1cb5-4e69-a3c6-0df85bbf1f49 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.437637 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7fd39-1cb5-4e69-a3c6-0df85bbf1f49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.444931 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7fd39-1cb5-4e69-a3c6-0df85bbf1f49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.446425 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7fd39-1cb5-4e69-a3c6-0df85bbf1f49 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application [None req-f0d7fd39-1cb5-4e69-a3c6-0df85bbf1f49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:16.458274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:16.460013 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:16.461732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:16.461732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:16.461732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:16.461732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:16.461732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:16.461732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:16.461732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:16.461732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: ERROR keystone.server.flask.application Aug 23 16:13:16.461732 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 456/906] 10.222.0.47 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:16.467016 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2efe9-bce4-4aba-9a5b-2ed80fba785c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:16.519095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:16.578137 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2efe9-bce4-4aba-9a5b-2ed80fba785c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.630869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911297e6-da79-4524-8b11-4a032d75444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:16.631476 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911297e6-da79-4524-8b11-4a032d75444e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.631754 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911297e6-da79-4524-8b11-4a032d75444e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.632021 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911297e6-da79-4524-8b11-4a032d75444e None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.632714 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911297e6-da79-4524-8b11-4a032d75444e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:16.633016 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911297e6-da79-4524-8b11-4a032d75444e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.634494 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911297e6-da79-4524-8b11-4a032d75444e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.647288 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 451/907] 10.222.0.47 () {56 vars in 1148 bytes} [Tue Aug 23 16:13:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:16.653618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7fd39-1cb5-4e69-a3c6-0df85bbf1f49 None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:16.765186 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7fd39-1cb5-4e69-a3c6-0df85bbf1f49 None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.801550 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2607a-b32b-493b-83c7-6e97043f4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:16.802159 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2607a-b32b-493b-83c7-6e97043f4aa0 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.802427 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2607a-b32b-493b-83c7-6e97043f4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.802685 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2607a-b32b-493b-83c7-6e97043f4aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.803400 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2607a-b32b-493b-83c7-6e97043f4aa0 None admin] RBAC: Adding query filter params (role.id=5756384fa8d842139e2f1fc44c5088bd, scope.project.id=ce23217f97fd4906afea681353330615, user.id=19c2519ed2e747e78a2ca91c3625a20d) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:16.803701 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2607a-b32b-493b-83c7-6e97043f4aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.805127 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2607a-b32b-493b-83c7-6e97043f4aa0 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.811150 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 457/908] 10.222.0.47 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:16 2022] GET /identity/v3/role_assignments?user.id=19c2519ed2e747e78a2ca91c3625a20d&scope.project.id=ce23217f97fd4906afea681353330615&role.id=5756384fa8d842139e2f1fc44c5088bd => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:19.010158 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c17e8-a3ca-4493-8955-a295b87c4f8c None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:19.010777 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c17e8-a3ca-4493-8955-a295b87c4f8c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:19.010777 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c17e8-a3ca-4493-8955-a295b87c4f8c None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:19.012026 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 452/909] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:19.018298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe2e7d-10bd-4633-8870-55af7fa5ee41 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:19.018825 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe2e7d-10bd-4633-8870-55af7fa5ee41 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:19.018825 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe2e7d-10bd-4633-8870-55af7fa5ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:19.037952 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-fcbe2e7d-10bd-4633-8870-55af7fa5ee41 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:19.039341 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-fcbe2e7d-10bd-4633-8870-55af7fa5ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:19.081764 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:19.132752 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 458/910] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:19 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:19.464571 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c17e8-a3ca-4493-8955-a295b87c4f8c None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:19.602866 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c17e8-a3ca-4493-8955-a295b87c4f8c None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:19.614030 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:19.645076 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c078e78-d33a-42bc-adcc-d5d47b30f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:19.645703 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c078e78-d33a-42bc-adcc-d5d47b30f297 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:19.645976 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c078e78-d33a-42bc-adcc-d5d47b30f297 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:19.646273 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c078e78-d33a-42bc-adcc-d5d47b30f297 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:19.646859 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c078e78-d33a-42bc-adcc-d5d47b30f297 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:19.648319 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c078e78-d33a-42bc-adcc-d5d47b30f297 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-6c078e78-d33a-42bc-adcc-d5d47b30f297 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:19.657837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:19.659081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:19.660127 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 453/911] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 23 16:13:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:19.669777 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe2e7d-10bd-4633-8870-55af7fa5ee41 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:19.803238 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe2e7d-10bd-4633-8870-55af7fa5ee41 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:19.843678 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524157b-7753-4623-a6b4-8dd1f73e0768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:19.844288 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524157b-7753-4623-a6b4-8dd1f73e0768 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:19.844566 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524157b-7753-4623-a6b4-8dd1f73e0768 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:19.844837 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524157b-7753-4623-a6b4-8dd1f73e0768 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:19.845474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524157b-7753-4623-a6b4-8dd1f73e0768 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:19.845774 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524157b-7753-4623-a6b4-8dd1f73e0768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:19.847298 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524157b-7753-4623-a6b4-8dd1f73e0768 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:19.852667 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 459/912] 10.222.0.47 () {56 vars in 1116 bytes} [Tue Aug 23 16:13:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:19.858760 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c078e78-d33a-42bc-adcc-d5d47b30f297 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:19.970398 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c078e78-d33a-42bc-adcc-d5d47b30f297 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:20.007196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b00a4-0f7f-4c78-a57f-eb95679117bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:20.007795 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b00a4-0f7f-4c78-a57f-eb95679117bf None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:20.008071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b00a4-0f7f-4c78-a57f-eb95679117bf None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:20.008341 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b00a4-0f7f-4c78-a57f-eb95679117bf None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:20.008970 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b00a4-0f7f-4c78-a57f-eb95679117bf None admin] RBAC: Adding query filter params (type=placement) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:20.009272 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b00a4-0f7f-4c78-a57f-eb95679117bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:20.010663 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b00a4-0f7f-4c78-a57f-eb95679117bf None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:20.015472 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 454/913] 10.222.0.47 () {56 vars in 1116 bytes} [Tue Aug 23 16:13:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:22.239232 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3704a6e-c879-40d6-a7b7-f32be69afad1 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:22.239833 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3704a6e-c879-40d6-a7b7-f32be69afad1 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:22.239833 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3704a6e-c879-40d6-a7b7-f32be69afad1 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:22.241073 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 460/914] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:22.246407 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c615c2f-413f-42a3-bf83-117417bd257d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:22.246827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c615c2f-413f-42a3-bf83-117417bd257d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:22.246950 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c615c2f-413f-42a3-bf83-117417bd257d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:22.266298 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-7c615c2f-413f-42a3-bf83-117417bd257d None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:22.267516 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-7c615c2f-413f-42a3-bf83-117417bd257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:22.296170 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:22.338245 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 455/915] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:22 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:22.654412 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3704a6e-c879-40d6-a7b7-f32be69afad1 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:22.691494 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:22.767401 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3704a6e-c879-40d6-a7b7-f32be69afad1 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:22.803832 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40690a-0cbc-4a9b-9892-d7535e43ae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:22.804439 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40690a-0cbc-4a9b-9892-d7535e43ae49 None admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:22.804709 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40690a-0cbc-4a9b-9892-d7535e43ae49 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:22.804980 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40690a-0cbc-4a9b-9892-d7535e43ae49 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:22.805612 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40690a-0cbc-4a9b-9892-d7535e43ae49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:22.807001 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40690a-0cbc-4a9b-9892-d7535e43ae49 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:22.823250 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 461/916] 10.222.0.47 () {60 vars in 1141 bytes} [Tue Aug 23 16:13:22 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:25.027060 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf34030-0689-4276-a885-d42f1834372b None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.028002 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf34030-0689-4276-a885-d42f1834372b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.028002 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf34030-0689-4276-a885-d42f1834372b None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.030054 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 456/917] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:13:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:25.039064 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef7366-e222-4920-bb67-52e5b785d837 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.039761 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef7366-e222-4920-bb67-52e5b785d837 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.039903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef7366-e222-4920-bb67-52e5b785d837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.063768 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-3eef7366-e222-4920-bb67-52e5b785d837 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:25.065249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-3eef7366-e222-4920-bb67-52e5b785d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:25.149723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 462/918] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:25 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:25.480495 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf34030-0689-4276-a885-d42f1834372b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:25.588119 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf34030-0689-4276-a885-d42f1834372b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:25.623562 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d1ba7-fa8c-4553-8c3a-2ed619993acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:25.624182 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d1ba7-fa8c-4553-8c3a-2ed619993acf None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.624452 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d1ba7-fa8c-4553-8c3a-2ed619993acf None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.624717 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d1ba7-fa8c-4553-8c3a-2ed619993acf None admin] PATH_INFO: `/v3/services/placement` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.625325 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d1ba7-fa8c-4553-8c3a-2ed619993acf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:25.626721 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d1ba7-fa8c-4553-8c3a-2ed619993acf None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-517d1ba7-fa8c-4553-8c3a-2ed619993acf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:25.635680 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:25.636815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:25.637682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 457/919] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 23 16:13:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:25.643294 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef7366-e222-4920-bb67-52e5b785d837 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:25.662243 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:25.748173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef7366-e222-4920-bb67-52e5b785d837 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:25.782871 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6041ef-9edd-4059-870c-5dabd49d93de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:25.783482 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6041ef-9edd-4059-870c-5dabd49d93de None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.783756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6041ef-9edd-4059-870c-5dabd49d93de None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.784022 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6041ef-9edd-4059-870c-5dabd49d93de None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.784648 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6041ef-9edd-4059-870c-5dabd49d93de None admin] RBAC: Adding query filter params (name=placement) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:25.784941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6041ef-9edd-4059-870c-5dabd49d93de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:25.786346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6041ef-9edd-4059-870c-5dabd49d93de None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:25.791443 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 463/920] 10.222.0.47 () {56 vars in 1116 bytes} [Tue Aug 23 16:13:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:25.797923 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d1ba7-fa8c-4553-8c3a-2ed619993acf None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:25.828551 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:25.905229 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d1ba7-fa8c-4553-8c3a-2ed619993acf None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:25.941139 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e342f-05c5-4f49-83fd-0604af5e9dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:25.941733 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e342f-05c5-4f49-83fd-0604af5e9dbd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.942040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e342f-05c5-4f49-83fd-0604af5e9dbd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.942307 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e342f-05c5-4f49-83fd-0604af5e9dbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.943008 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e342f-05c5-4f49-83fd-0604af5e9dbd None admin] RBAC: Adding query filter params (interface=public, service_id=f7ef0a6189974de19e9a5051f1513148, region_id=RegionOne) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:25.943311 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e342f-05c5-4f49-83fd-0604af5e9dbd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:25.944687 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e342f-05c5-4f49-83fd-0604af5e9dbd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:25.949881 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 458/921] 10.222.0.47 () {56 vars in 1251 bytes} [Tue Aug 23 16:13:25 2022] GET /identity/v3/endpoints?service_id=f7ef0a6189974de19e9a5051f1513148&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:25.956106 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6041ef-9edd-4059-870c-5dabd49d93de None admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:26.048349 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:26.067254 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6041ef-9edd-4059-870c-5dabd49d93de None admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:26.103186 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534186d-4081-4d13-9300-77ac69e90768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:26.103821 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534186d-4081-4d13-9300-77ac69e90768 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:26.104094 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534186d-4081-4d13-9300-77ac69e90768 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:26.104361 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534186d-4081-4d13-9300-77ac69e90768 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:26.104955 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534186d-4081-4d13-9300-77ac69e90768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:26.106365 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534186d-4081-4d13-9300-77ac69e90768 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:26.113189 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 464/922] 10.222.0.47 () {56 vars in 1087 bytes} [Tue Aug 23 16:13:25 2022] GET /identity/v3/services => generated 1962 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:13:28.277006 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52ee7f-fffa-4f26-a49e-193574eb7bfd None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:28.277729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52ee7f-fffa-4f26-a49e-193574eb7bfd None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:28.277729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52ee7f-fffa-4f26-a49e-193574eb7bfd None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:28.278985 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 459/923] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:28.285521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d49bfe-d0cf-4de5-9718-88027d866cbe None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:28.286271 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d49bfe-d0cf-4de5-9718-88027d866cbe None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:28.286417 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d49bfe-d0cf-4de5-9718-88027d866cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:28.314997 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-32d49bfe-d0cf-4de5-9718-88027d866cbe None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:28.316191 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-32d49bfe-d0cf-4de5-9718-88027d866cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:28.389485 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 465/924] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:28 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:28.723012 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52ee7f-fffa-4f26-a49e-193574eb7bfd None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:28.822742 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:28.833121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52ee7f-fffa-4f26-a49e-193574eb7bfd None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:28.868679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7f3db-7674-4435-8a7e-26d195ce2d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:28.869295 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7f3db-7674-4435-8a7e-26d195ce2d28 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:28.869566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7f3db-7674-4435-8a7e-26d195ce2d28 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:28.869830 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7f3db-7674-4435-8a7e-26d195ce2d28 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:28.870537 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7f3db-7674-4435-8a7e-26d195ce2d28 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:28.871907 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7f3db-7674-4435-8a7e-26d195ce2d28 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-8db7f3db-7674-4435-8a7e-26d195ce2d28 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:28.880620 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:28.881819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Aug 23 16:13:28.882746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 460/925] 10.222.0.47 () {56 vars in 1117 bytes} [Tue Aug 23 16:13:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:28.888271 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d49bfe-d0cf-4de5-9718-88027d866cbe None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:28.969447 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:28.996768 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d49bfe-d0cf-4de5-9718-88027d866cbe None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:29.039309 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3818f-b9a5-4f70-bf71-d33b50010414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:29.040138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3818f-b9a5-4f70-bf71-d33b50010414 None admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:29.040547 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3818f-b9a5-4f70-bf71-d33b50010414 None admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:29.040949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3818f-b9a5-4f70-bf71-d33b50010414 None admin] PATH_INFO: `/v3/services` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:29.042292 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3818f-b9a5-4f70-bf71-d33b50010414 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:29.042597 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3818f-b9a5-4f70-bf71-d33b50010414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:29.044766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3818f-b9a5-4f70-bf71-d33b50010414 None admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:29.051858 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 466/926] 10.222.0.47 () {56 vars in 1116 bytes} [Tue Aug 23 16:13:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:29.058025 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7f3db-7674-4435-8a7e-26d195ce2d28 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:29.177828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7f3db-7674-4435-8a7e-26d195ce2d28 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:29.220648 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae03afd-532a-4023-9c7e-6b20b532ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:29.221255 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae03afd-532a-4023-9c7e-6b20b532ddcc None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:29.221532 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae03afd-532a-4023-9c7e-6b20b532ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:29.221803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae03afd-532a-4023-9c7e-6b20b532ddcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:29.222498 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae03afd-532a-4023-9c7e-6b20b532ddcc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:29.223886 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae03afd-532a-4023-9c7e-6b20b532ddcc None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:29.249365 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 461/927] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 23 16:13:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:39.047641 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=30 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:39.243614 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:31.330433 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46972d8-e0bd-45c1-9af5-39f9cd42ebb3 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:31.331230 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46972d8-e0bd-45c1-9af5-39f9cd42ebb3 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:31.331230 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46972d8-e0bd-45c1-9af5-39f9cd42ebb3 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:31.332306 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 467/928] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:31.337933 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503253b-0300-4437-833f-3014c7becdf6 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:31.338483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503253b-0300-4437-833f-3014c7becdf6 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:31.338483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503253b-0300-4437-833f-3014c7becdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:31.360500 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-3503253b-0300-4437-833f-3014c7becdf6 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:31.361911 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-3503253b-0300-4437-833f-3014c7becdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:31.454171 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 462/929] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:14:31.799345 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc9403-d4d3-4d68-bc72-7761d9d3a5ae None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:31.799951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc9403-d4d3-4d68-bc72-7761d9d3a5ae None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:31.800372 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc9403-d4d3-4d68-bc72-7761d9d3a5ae None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:31.801904 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 468/930] 10.222.0.47 () {54 vars in 965 bytes} [Tue Aug 23 16:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:31.809077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585d239-32fb-4bc7-b7a4-ff26bdc96091 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:31.809666 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585d239-32fb-4bc7-b7a4-ff26bdc96091 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:31.810053 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585d239-32fb-4bc7-b7a4-ff26bdc96091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:31.873153 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-9585d239-32fb-4bc7-b7a4-ff26bdc96091 None None] MFA Rules not processed for user `2562343e356e47fc86503e2b9cfa0269`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:31.874849 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-9585d239-32fb-4bc7-b7a4-ff26bdc96091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:31.940760 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 463/931] 10.222.0.47 () {58 vars in 1062 bytes} [Tue Aug 23 16:14:31 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:14:31.949611 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc9403-d4d3-4d68-bc72-7761d9d3a5ae None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:31.962505 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc9403-d4d3-4d68-bc72-7761d9d3a5ae None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:31.966586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a6985-765d-4e45-a7dd-34649228a4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:31.967255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6985-765d-4e45-a7dd-34649228a4cb service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:31.967594 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6985-765d-4e45-a7dd-34649228a4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:31.967929 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6985-765d-4e45-a7dd-34649228a4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:31.978081 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a6985-765d-4e45-a7dd-34649228a4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:31.979517 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a6985-765d-4e45-a7dd-34649228a4cb service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:31.989968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 469/932] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:14:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:14:34.472939 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ac7dd-d217-4ef5-b334-26078ba41d72 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:34.473889 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ac7dd-d217-4ef5-b334-26078ba41d72 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:34.474360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ac7dd-d217-4ef5-b334-26078ba41d72 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:34.480203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 464/933] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:14:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:34.482076 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fbf78-7979-4be0-9b87-f0bc22e091de None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:34.482592 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fbf78-7979-4be0-9b87-f0bc22e091de None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:34.482852 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fbf78-7979-4be0-9b87-f0bc22e091de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:34.509490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-9a1fbf78-7979-4be0-9b87-f0bc22e091de None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:34.511180 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-9a1fbf78-7979-4be0-9b87-f0bc22e091de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:34.521530 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 470/934] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:14:34.864803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ac7dd-d217-4ef5-b334-26078ba41d72 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:34.876679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ac7dd-d217-4ef5-b334-26078ba41d72 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:34.880828 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638690e-727c-4fa0-99ee-84e6fd09fa1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:34.881572 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638690e-727c-4fa0-99ee-84e6fd09fa1c service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:34.881953 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638690e-727c-4fa0-99ee-84e6fd09fa1c service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:34.882381 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638690e-727c-4fa0-99ee-84e6fd09fa1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:34.892950 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638690e-727c-4fa0-99ee-84e6fd09fa1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:34.894627 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638690e-727c-4fa0-99ee-84e6fd09fa1c service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:34.906021 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 465/935] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:14:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:14:37.607274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5263b1-d33a-47ad-a147-21bba3d179be None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:37.607850 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5263b1-d33a-47ad-a147-21bba3d179be None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:37.607850 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5263b1-d33a-47ad-a147-21bba3d179be None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:37.609481 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 471/936] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:37.614845 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902b1b-db1b-4074-8d81-13474c1df71e None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:37.615275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902b1b-db1b-4074-8d81-13474c1df71e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:37.615389 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902b1b-db1b-4074-8d81-13474c1df71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:37.657123 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-ba902b1b-db1b-4074-8d81-13474c1df71e None None] MFA Rules not processed for user `c19d4b6580e74231a49a6689514513af`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:37.658373 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-ba902b1b-db1b-4074-8d81-13474c1df71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:37.703957 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:37.733796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 466/937] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:37 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:14:38.208628 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5263b1-d33a-47ad-a147-21bba3d179be None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:38.220881 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5263b1-d33a-47ad-a147-21bba3d179be None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:38.225269 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901ef80-c5ec-4e81-b837-eaced081aa0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:38.225877 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901ef80-c5ec-4e81-b837-eaced081aa0f service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:38.226196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901ef80-c5ec-4e81-b837-eaced081aa0f service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:38.226484 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901ef80-c5ec-4e81-b837-eaced081aa0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:38.236709 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901ef80-c5ec-4e81-b837-eaced081aa0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:38.238191 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901ef80-c5ec-4e81-b837-eaced081aa0f service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:38.248075 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 472/938] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:14:38 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:14:41.043093 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219d49c-ac67-485d-9713-552a77a7e2f8 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:41.043647 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219d49c-ac67-485d-9713-552a77a7e2f8 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:41.043647 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219d49c-ac67-485d-9713-552a77a7e2f8 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:41.045242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 467/939] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:41.050968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148358a8-f4e2-49fb-9387-13a2581ac985 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:41.051433 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148358a8-f4e2-49fb-9387-13a2581ac985 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:41.051525 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148358a8-f4e2-49fb-9387-13a2581ac985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:41.071991 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-148358a8-f4e2-49fb-9387-13a2581ac985 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:41.073202 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-148358a8-f4e2-49fb-9387-13a2581ac985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:41.147335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 473/940] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:41 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:14:41.494363 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a80a3-9033-431d-a523-92160a4bb5b4 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:41.494733 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a80a3-9033-431d-a523-92160a4bb5b4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:41.495089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a80a3-9033-431d-a523-92160a4bb5b4 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:41.496427 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 468/941] 10.222.0.47 () {54 vars in 965 bytes} [Tue Aug 23 16:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:41.502899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4abf5-5991-4ecd-a425-da6465e6988a None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:41.503185 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4abf5-5991-4ecd-a425-da6465e6988a None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:41.503456 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4abf5-5991-4ecd-a425-da6465e6988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:41.525288 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-21a4abf5-5991-4ecd-a425-da6465e6988a None None] MFA Rules not processed for user `2562343e356e47fc86503e2b9cfa0269`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:41.526525 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-21a4abf5-5991-4ecd-a425-da6465e6988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:41.533694 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 474/942] 10.222.0.47 () {58 vars in 1062 bytes} [Tue Aug 23 16:14:41 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:14:41.542647 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a80a3-9033-431d-a523-92160a4bb5b4 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:41.555288 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a80a3-9033-431d-a523-92160a4bb5b4 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:41.559235 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e9b48-d273-4c0d-8c13-85ba6b50e429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:41.559807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e9b48-d273-4c0d-8c13-85ba6b50e429 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:41.560099 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e9b48-d273-4c0d-8c13-85ba6b50e429 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:41.560369 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e9b48-d273-4c0d-8c13-85ba6b50e429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:41.569602 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e9b48-d273-4c0d-8c13-85ba6b50e429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:41.571067 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e9b48-d273-4c0d-8c13-85ba6b50e429 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:41.580460 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 469/943] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:14:41 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:14:44.871467 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8ca75-d115-451c-8f11-420cb7227ab2 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:44.872030 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8ca75-d115-451c-8f11-420cb7227ab2 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:44.872420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8ca75-d115-451c-8f11-420cb7227ab2 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:44.874747 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 475/944] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:14:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:44.882406 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c7808-d2e6-4832-9025-93359db641c0 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:44.883060 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c7808-d2e6-4832-9025-93359db641c0 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:44.883060 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c7808-d2e6-4832-9025-93359db641c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:44.906391 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-669c7808-d2e6-4832-9025-93359db641c0 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:44.907768 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-669c7808-d2e6-4832-9025-93359db641c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:44.917054 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 470/945] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:14:45.250296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8ca75-d115-451c-8f11-420cb7227ab2 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:45.263719 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8ca75-d115-451c-8f11-420cb7227ab2 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:45.267766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d14f3-7c44-47e7-b3bb-6915e1a1da9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:45.268372 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d14f3-7c44-47e7-b3bb-6915e1a1da9a service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:45.268645 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d14f3-7c44-47e7-b3bb-6915e1a1da9a service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:45.268908 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d14f3-7c44-47e7-b3bb-6915e1a1da9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:45.279387 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d14f3-7c44-47e7-b3bb-6915e1a1da9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:45.280879 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d14f3-7c44-47e7-b3bb-6915e1a1da9a service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:45.292912 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 476/946] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:14:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:14:47.497596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dfb04-4570-4e18-93b1-fbce560e4ad7 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:47.498171 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dfb04-4570-4e18-93b1-fbce560e4ad7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:47.498171 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dfb04-4570-4e18-93b1-fbce560e4ad7 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:47.499628 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 471/947] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:47.504895 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484c8f-02d4-43fb-816d-2ac164a122e4 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:47.505332 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484c8f-02d4-43fb-816d-2ac164a122e4 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:47.505434 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484c8f-02d4-43fb-816d-2ac164a122e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:47.525407 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-87484c8f-02d4-43fb-816d-2ac164a122e4 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:47.526628 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-87484c8f-02d4-43fb-816d-2ac164a122e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:47.535557 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 477/948] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:14:47.866787 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dfb04-4570-4e18-93b1-fbce560e4ad7 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:47.879173 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dfb04-4570-4e18-93b1-fbce560e4ad7 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:47.883166 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec436cbf-d223-4d5a-aa44-2e319a90a87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:47.883763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec436cbf-d223-4d5a-aa44-2e319a90a87d service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:47.884039 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec436cbf-d223-4d5a-aa44-2e319a90a87d service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:47.884310 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec436cbf-d223-4d5a-aa44-2e319a90a87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:47.893428 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec436cbf-d223-4d5a-aa44-2e319a90a87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:47.894905 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec436cbf-d223-4d5a-aa44-2e319a90a87d service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:47.904265 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 472/949] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:14:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:14:50.126411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbc5d4-de46-4163-98c0-95ee28de7505 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:50.126942 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbc5d4-de46-4163-98c0-95ee28de7505 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:50.126942 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbc5d4-de46-4163-98c0-95ee28de7505 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:50.128246 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 478/950] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:50.133609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd8fd8-2515-4603-b4a9-6d10a3763717 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:50.134066 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd8fd8-2515-4603-b4a9-6d10a3763717 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:50.134319 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd8fd8-2515-4603-b4a9-6d10a3763717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:50.153670 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-bcfd8fd8-2515-4603-b4a9-6d10a3763717 None None] MFA Rules not processed for user `c19d4b6580e74231a49a6689514513af`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:50.154888 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-bcfd8fd8-2515-4603-b4a9-6d10a3763717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:50.163097 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 473/951] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:50 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:14:50.493808 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbc5d4-de46-4163-98c0-95ee28de7505 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:50.508965 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbc5d4-de46-4163-98c0-95ee28de7505 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:50.512562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d967f0a-9c2a-4968-b56f-74cdc04a1305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:50.513175 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d967f0a-9c2a-4968-b56f-74cdc04a1305 service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:50.513448 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d967f0a-9c2a-4968-b56f-74cdc04a1305 service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:50.513716 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d967f0a-9c2a-4968-b56f-74cdc04a1305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:50.522989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d967f0a-9c2a-4968-b56f-74cdc04a1305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:50.524433 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d967f0a-9c2a-4968-b56f-74cdc04a1305 service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:50.533733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 479/952] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:14:50 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:14:52.918085 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cd3fc-25bd-421b-b942-d7fccb7fe85f None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:52.918624 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cd3fc-25bd-421b-b942-d7fccb7fe85f None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:52.918740 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cd3fc-25bd-421b-b942-d7fccb7fe85f None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:52.920123 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 474/953] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:52.926600 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fb2e2-1b86-45ca-893d-d781e101b04c None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:52.927146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fb2e2-1b86-45ca-893d-d781e101b04c None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:52.927146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fb2e2-1b86-45ca-893d-d781e101b04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:52.948695 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-3d8fb2e2-1b86-45ca-893d-d781e101b04c None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:52.949920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-3d8fb2e2-1b86-45ca-893d-d781e101b04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:52.959190 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 480/954] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:14:53.286361 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cd3fc-25bd-421b-b942-d7fccb7fe85f None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:53.298190 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cd3fc-25bd-421b-b942-d7fccb7fe85f None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:53.302037 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dd032-f550-4c0b-9ff2-3df131c4be1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:53.302716 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dd032-f550-4c0b-9ff2-3df131c4be1e service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:53.302960 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dd032-f550-4c0b-9ff2-3df131c4be1e service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:53.303223 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dd032-f550-4c0b-9ff2-3df131c4be1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:53.313205 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dd032-f550-4c0b-9ff2-3df131c4be1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:53.314689 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dd032-f550-4c0b-9ff2-3df131c4be1e service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:53.324693 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 475/955] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:14:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:14:55.530371 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3e3bd-1d7f-4323-b2e5-ed9dbeafb158 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:55.530902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3e3bd-1d7f-4323-b2e5-ed9dbeafb158 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:55.530902 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3e3bd-1d7f-4323-b2e5-ed9dbeafb158 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:55.532297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 481/956] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:55.537789 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9c8a-9e8c-4c2f-98c4-735dfe380d23 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:55.538273 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9c8a-9e8c-4c2f-98c4-735dfe380d23 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:55.538365 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9c8a-9e8c-4c2f-98c4-735dfe380d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:55.558745 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-690f9c8a-9e8c-4c2f-98c4-735dfe380d23 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:55.559962 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-690f9c8a-9e8c-4c2f-98c4-735dfe380d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:55.569618 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 476/957] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:14:55.909846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3e3bd-1d7f-4323-b2e5-ed9dbeafb158 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:55.922247 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3e3bd-1d7f-4323-b2e5-ed9dbeafb158 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:55.927478 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee629767-03e3-4821-a6cb-e71461492870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:55.928547 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee629767-03e3-4821-a6cb-e71461492870 service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:55.928915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee629767-03e3-4821-a6cb-e71461492870 service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:55.929263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee629767-03e3-4821-a6cb-e71461492870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:55.939615 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee629767-03e3-4821-a6cb-e71461492870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:55.941036 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee629767-03e3-4821-a6cb-e71461492870 service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:55.950962 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 482/958] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:14:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:14:58.543829 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86893c-6dde-48a9-a08a-737e1b2c5873 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:58.544381 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86893c-6dde-48a9-a08a-737e1b2c5873 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:58.544381 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86893c-6dde-48a9-a08a-737e1b2c5873 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:58.545704 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 477/959] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:58.551409 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85000c14-4c5a-42e8-8f2d-5a07c89aacc5 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:58.551836 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85000c14-4c5a-42e8-8f2d-5a07c89aacc5 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:58.551951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85000c14-4c5a-42e8-8f2d-5a07c89aacc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:58.571381 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-85000c14-4c5a-42e8-8f2d-5a07c89aacc5 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:58.572583 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-85000c14-4c5a-42e8-8f2d-5a07c89aacc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:58.581003 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 483/960] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:58 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:14:58.911992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86893c-6dde-48a9-a08a-737e1b2c5873 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:58.924394 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86893c-6dde-48a9-a08a-737e1b2c5873 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:58.928431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ee328-0911-4c29-bc51-f2427c36106f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:58.929012 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ee328-0911-4c29-bc51-f2427c36106f service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:58.929283 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ee328-0911-4c29-bc51-f2427c36106f service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:58.929550 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ee328-0911-4c29-bc51-f2427c36106f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:58.938664 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ee328-0911-4c29-bc51-f2427c36106f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:58.940083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ee328-0911-4c29-bc51-f2427c36106f service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:58.949405 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 478/961] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:14:58 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:03.219031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5cc5f-9adc-47fe-929e-99fde86aa097 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:03.219662 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5cc5f-9adc-47fe-929e-99fde86aa097 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:03.219662 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5cc5f-9adc-47fe-929e-99fde86aa097 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:03.220910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 484/962] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:03.226436 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef19c6d-6936-4a34-b990-681437d5c658 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:03.226949 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef19c6d-6936-4a34-b990-681437d5c658 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:03.226949 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef19c6d-6936-4a34-b990-681437d5c658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:03.246639 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-eef19c6d-6936-4a34-b990-681437d5c658 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:03.247848 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-eef19c6d-6936-4a34-b990-681437d5c658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:03.256288 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 479/963] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:03.598727 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5cc5f-9adc-47fe-929e-99fde86aa097 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:03.604687 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=77 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:03.612060 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5cc5f-9adc-47fe-929e-99fde86aa097 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:03.615776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4afa1a-8a53-4020-afaa-2b6cd7c90e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:03.616389 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4afa1a-8a53-4020-afaa-2b6cd7c90e47 service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:03.616697 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4afa1a-8a53-4020-afaa-2b6cd7c90e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:03.616930 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4afa1a-8a53-4020-afaa-2b6cd7c90e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:03.626784 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4afa1a-8a53-4020-afaa-2b6cd7c90e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:03.628231 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4afa1a-8a53-4020-afaa-2b6cd7c90e47 service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:03.637913 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 485/964] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:06.564842 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19582ba3-375b-448a-b575-b08a6c1033b5 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:06.565513 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19582ba3-375b-448a-b575-b08a6c1033b5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:06.565513 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19582ba3-375b-448a-b575-b08a6c1033b5 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:06.566932 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 480/965] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:06.572327 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32fcef-2d0b-43bf-b52d-716b6eb41b3c None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:06.572810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32fcef-2d0b-43bf-b52d-716b6eb41b3c None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:06.572810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32fcef-2d0b-43bf-b52d-716b6eb41b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:06.593901 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-ea32fcef-2d0b-43bf-b52d-716b6eb41b3c None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:06.595237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-ea32fcef-2d0b-43bf-b52d-716b6eb41b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:06.604542 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 486/966] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:06 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:06.990331 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19582ba3-375b-448a-b575-b08a6c1033b5 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:07.003726 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19582ba3-375b-448a-b575-b08a6c1033b5 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:07.007704 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa70c86-03a1-4f43-919f-ae3e003dda58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:07.008310 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa70c86-03a1-4f43-919f-ae3e003dda58 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:07.008586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa70c86-03a1-4f43-919f-ae3e003dda58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:07.008856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa70c86-03a1-4f43-919f-ae3e003dda58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:07.018679 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa70c86-03a1-4f43-919f-ae3e003dda58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:07.020194 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa70c86-03a1-4f43-919f-ae3e003dda58 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:07.031753 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 481/967] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:06 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:15:11.507275 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0c82-a909-44f9-996d-f4d6b2d60901 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:11.507927 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0c82-a909-44f9-996d-f4d6b2d60901 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:11.507927 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0c82-a909-44f9-996d-f4d6b2d60901 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:11.509266 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 487/968] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:11.515374 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6820cd-8517-4a2a-879e-70652f48955f None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:11.515923 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6820cd-8517-4a2a-879e-70652f48955f None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:11.515923 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6820cd-8517-4a2a-879e-70652f48955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:11.523886 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=54 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:11.537981 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-fe6820cd-8517-4a2a-879e-70652f48955f None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:11.539418 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-fe6820cd-8517-4a2a-879e-70652f48955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:11.550152 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 482/969] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:12.011074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd0c82-a909-44f9-996d-f4d6b2d60901 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:12.024014 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd0c82-a909-44f9-996d-f4d6b2d60901 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:12.027842 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfe6b0-d50a-4406-840b-a1ad5b675f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:12.028532 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe6b0-d50a-4406-840b-a1ad5b675f99 service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:12.028720 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe6b0-d50a-4406-840b-a1ad5b675f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:12.028986 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe6b0-d50a-4406-840b-a1ad5b675f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:12.038847 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfe6b0-d50a-4406-840b-a1ad5b675f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:12.040270 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfe6b0-d50a-4406-840b-a1ad5b675f99 service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:12.051389 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 488/970] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:18.156092 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db100b-e13b-4afa-934a-a040a25969d4 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:18.156092 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db100b-e13b-4afa-934a-a040a25969d4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:18.156092 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db100b-e13b-4afa-934a-a040a25969d4 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:18.157397 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 483/971] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 23 16:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:15:18.163263 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f5121-e3e0-4601-bc2e-a8e981d7c8b8 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:18.163811 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f5121-e3e0-4601-bc2e-a8e981d7c8b8 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:18.163932 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f5121-e3e0-4601-bc2e-a8e981d7c8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:18.243811 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-176f5121-e3e0-4601-bc2e-a8e981d7c8b8 None None] MFA Rules not processed for user `19c2519ed2e747e78a2ca91c3625a20d`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:18.245975 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-176f5121-e3e0-4601-bc2e-a8e981d7c8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:18.425108 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 489/972] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 23 16:15:18 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:21.535607 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=2 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:23.329983 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae9504-19f0-4098-98df-88abac255ebb None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.330623 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae9504-19f0-4098-98df-88abac255ebb None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.330623 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae9504-19f0-4098-98df-88abac255ebb None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.332393 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 484/973] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 23 16:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:23.338738 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa1d0a-fa4a-4f3a-861c-02c06059bca6 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.339267 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa1d0a-fa4a-4f3a-861c-02c06059bca6 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.339347 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa1d0a-fa4a-4f3a-861c-02c06059bca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.361207 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-bbfa1d0a-fa4a-4f3a-861c-02c06059bca6 None None] MFA Rules not processed for user `19c2519ed2e747e78a2ca91c3625a20d`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:23.362440 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-bbfa1d0a-fa4a-4f3a-861c-02c06059bca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:23.372309 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 490/974] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 23 16:15:23 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:25.358310 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264d034-d2d0-450c-942c-8e40d8eaa134 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:25.358923 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264d034-d2d0-450c-942c-8e40d8eaa134 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:25.358923 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264d034-d2d0-450c-942c-8e40d8eaa134 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:25.360420 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 485/975] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 23 16:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:25.365643 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02cec0-be89-4f1a-8b72-732eafc46ec3 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:25.366153 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02cec0-be89-4f1a-8b72-732eafc46ec3 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:25.366244 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02cec0-be89-4f1a-8b72-732eafc46ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:25.391877 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-2c02cec0-be89-4f1a-8b72-732eafc46ec3 None None] MFA Rules not processed for user `19c2519ed2e747e78a2ca91c3625a20d`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:25.393090 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-2c02cec0-be89-4f1a-8b72-732eafc46ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:25.403563 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 491/976] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 23 16:15:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:29.115304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042cd9-570e-4816-b0d3-90335dfe9369 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:29.115836 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042cd9-570e-4816-b0d3-90335dfe9369 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:29.115836 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042cd9-570e-4816-b0d3-90335dfe9369 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:29.117226 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 486/977] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:29.122438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ff7e7-076f-4394-a5f7-f4750b876646 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:29.122854 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ff7e7-076f-4394-a5f7-f4750b876646 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:29.122977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ff7e7-076f-4394-a5f7-f4750b876646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:29.143899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-5a0ff7e7-076f-4394-a5f7-f4750b876646 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:29.143899 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-5a0ff7e7-076f-4394-a5f7-f4750b876646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:29.151699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 492/978] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:29.510536 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b086fa-4765-4149-b6ab-25e4efd66886 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:29.511031 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b086fa-4765-4149-b6ab-25e4efd66886 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:29.511585 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b086fa-4765-4149-b6ab-25e4efd66886 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:29.513334 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 487/979] 10.222.0.47 () {54 vars in 962 bytes} [Tue Aug 23 16:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:29.522258 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c993-99eb-4888-8fe5-00c5682e8629 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:29.522844 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c993-99eb-4888-8fe5-00c5682e8629 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:29.523281 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c993-99eb-4888-8fe5-00c5682e8629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:29.593906 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-cb44c993-99eb-4888-8fe5-00c5682e8629 None None] MFA Rules not processed for user `9c6749b0664141529ce43b78fbc836ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:29.597951 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-cb44c993-99eb-4888-8fe5-00c5682e8629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:29.687466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:29.693849 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 493/980] 10.222.0.47 () {58 vars in 1059 bytes} [Tue Aug 23 16:15:29 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:15:29.701879 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b086fa-4765-4149-b6ab-25e4efd66886 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:29.716251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b086fa-4765-4149-b6ab-25e4efd66886 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:29.721652 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60c08d-9ed0-4262-b61b-ca488c51e534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:29.722443 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60c08d-9ed0-4262-b61b-ca488c51e534 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:29.722727 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60c08d-9ed0-4262-b61b-ca488c51e534 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:29.722997 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60c08d-9ed0-4262-b61b-ca488c51e534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:29.731819 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60c08d-9ed0-4262-b61b-ca488c51e534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:29.733516 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60c08d-9ed0-4262-b61b-ca488c51e534 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:29.746402 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 488/981] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:32.160139 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0d2e6-8f40-4579-bfa4-e1e0b3b85b3b None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:32.160791 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0d2e6-8f40-4579-bfa4-e1e0b3b85b3b None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:32.160791 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0d2e6-8f40-4579-bfa4-e1e0b3b85b3b None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:32.162184 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 494/982] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:32.167394 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19b9b3-9903-411e-98cc-594740e272d2 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:32.167858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19b9b3-9903-411e-98cc-594740e272d2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:32.167945 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19b9b3-9903-411e-98cc-594740e272d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:32.188061 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-3c19b9b3-9903-411e-98cc-594740e272d2 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:32.189334 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-3c19b9b3-9903-411e-98cc-594740e272d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:32.198208 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 489/983] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:32.545257 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0d2e6-8f40-4579-bfa4-e1e0b3b85b3b None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:32.559841 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0d2e6-8f40-4579-bfa4-e1e0b3b85b3b None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:32.568042 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e9772-26cd-4825-837c-8501277f5602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:32.569296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e9772-26cd-4825-837c-8501277f5602 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:32.569801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e9772-26cd-4825-837c-8501277f5602 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:32.570173 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e9772-26cd-4825-837c-8501277f5602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:32.579682 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e9772-26cd-4825-837c-8501277f5602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:32.581712 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e9772-26cd-4825-837c-8501277f5602 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:32.593591 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 495/984] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:15:35.227434 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be5d6f-cc47-4fdb-af88-7476df4a7c0d None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.227948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be5d6f-cc47-4fdb-af88-7476df4a7c0d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.238308 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be5d6f-cc47-4fdb-af88-7476df4a7c0d None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.240987 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 490/985] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:35 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:35.246705 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80783f7-43dc-43cd-b137-11ff8615ae22 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.247178 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80783f7-43dc-43cd-b137-11ff8615ae22 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.247297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80783f7-43dc-43cd-b137-11ff8615ae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.267129 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-b80783f7-43dc-43cd-b137-11ff8615ae22 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:35.268357 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-b80783f7-43dc-43cd-b137-11ff8615ae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:35.276845 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 496/986] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:35.619991 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2faa-4df2-4a42-88cb-be76fdf1ff3b None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.620473 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2faa-4df2-4a42-88cb-be76fdf1ff3b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.620841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2faa-4df2-4a42-88cb-be76fdf1ff3b None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.622380 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 491/987] 10.222.0.47 () {54 vars in 962 bytes} [Tue Aug 23 16:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:35.628150 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473267e6-8e07-4ee8-9363-78a3b6a33a0c None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.628428 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473267e6-8e07-4ee8-9363-78a3b6a33a0c None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.628700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473267e6-8e07-4ee8-9363-78a3b6a33a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.657429 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-473267e6-8e07-4ee8-9363-78a3b6a33a0c None None] MFA Rules not processed for user `9c6749b0664141529ce43b78fbc836ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:35.658757 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-473267e6-8e07-4ee8-9363-78a3b6a33a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:35.669021 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 497/988] 10.222.0.47 () {58 vars in 1059 bytes} [Tue Aug 23 16:15:35 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:35.678671 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2faa-4df2-4a42-88cb-be76fdf1ff3b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:35.695131 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2faa-4df2-4a42-88cb-be76fdf1ff3b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:35.702421 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00758b16-de28-4e70-8007-e92494f148ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:35.703035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00758b16-de28-4e70-8007-e92494f148ac service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.703306 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00758b16-de28-4e70-8007-e92494f148ac service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.703568 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00758b16-de28-4e70-8007-e92494f148ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.717394 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00758b16-de28-4e70-8007-e92494f148ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:35.720035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00758b16-de28-4e70-8007-e92494f148ac service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:35.733302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 492/989] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:38.204229 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482daf1-6273-42bc-a0b9-f088ccc79e1c None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.205233 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482daf1-6273-42bc-a0b9-f088ccc79e1c None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.205682 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482daf1-6273-42bc-a0b9-f088ccc79e1c None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.211651 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 498/990] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:38.212737 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d799e05-de35-458e-b14a-082dd420c1fb None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.213487 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d799e05-de35-458e-b14a-082dd420c1fb None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.213896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d799e05-de35-458e-b14a-082dd420c1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.234482 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-4d799e05-de35-458e-b14a-082dd420c1fb None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:38.235960 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-4d799e05-de35-458e-b14a-082dd420c1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:38.244461 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 493/991] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:38.618255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482daf1-6273-42bc-a0b9-f088ccc79e1c None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:38.632886 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482daf1-6273-42bc-a0b9-f088ccc79e1c None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:38.638492 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815105aa-f0c4-40e6-b687-34f34418eb89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:38.639354 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815105aa-f0c4-40e6-b687-34f34418eb89 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.639847 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815105aa-f0c4-40e6-b687-34f34418eb89 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.640313 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815105aa-f0c4-40e6-b687-34f34418eb89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.649402 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815105aa-f0c4-40e6-b687-34f34418eb89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:38.651363 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815105aa-f0c4-40e6-b687-34f34418eb89 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:38.675100 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 499/992] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:39.678925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842a93f-2539-4f44-9f45-e735500ade08 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:39.679486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842a93f-2539-4f44-9f45-e735500ade08 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:39.679486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842a93f-2539-4f44-9f45-e735500ade08 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:39.680941 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 494/993] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:39.686531 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127587f-011f-407d-8ae7-dfe5eef0d417 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:39.687443 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127587f-011f-407d-8ae7-dfe5eef0d417 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:39.688041 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127587f-011f-407d-8ae7-dfe5eef0d417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:39.710705 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-3127587f-011f-407d-8ae7-dfe5eef0d417 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:39.712315 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-3127587f-011f-407d-8ae7-dfe5eef0d417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:39.726356 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 500/994] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:40.279757 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869aa8-8ff0-4790-8c79-b41284177ccd None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.280101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869aa8-8ff0-4790-8c79-b41284177ccd None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.280309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869aa8-8ff0-4790-8c79-b41284177ccd None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.282199 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 495/995] 10.222.0.47 () {54 vars in 964 bytes} [Tue Aug 23 16:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:40.287854 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf8be6-7edb-4f31-97d1-3537cd757e0e None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.288148 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf8be6-7edb-4f31-97d1-3537cd757e0e None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.288418 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf8be6-7edb-4f31-97d1-3537cd757e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.333118 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-8faf8be6-7edb-4f31-97d1-3537cd757e0e None None] MFA Rules not processed for user `f2225825e32a488ea5bca33c00bb1b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:40.334415 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-8faf8be6-7edb-4f31-97d1-3537cd757e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:40.398756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 501/996] 10.222.0.47 () {58 vars in 1061 bytes} [Tue Aug 23 16:15:40 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:15:40.406836 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869aa8-8ff0-4790-8c79-b41284177ccd None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:40.418455 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869aa8-8ff0-4790-8c79-b41284177ccd None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:40.422335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e379d5d-9450-4b5c-976f-9f6d96ea5455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2225825e32a488ea5bca33c00bb1b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:40.422937 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e379d5d-9450-4b5c-976f-9f6d96ea5455 service cinder] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.423212 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e379d5d-9450-4b5c-976f-9f6d96ea5455 service cinder] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.423482 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e379d5d-9450-4b5c-976f-9f6d96ea5455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.434166 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e379d5d-9450-4b5c-976f-9f6d96ea5455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:40.436861 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e379d5d-9450-4b5c-976f-9f6d96ea5455 service cinder] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:40.448138 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 496/997] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:40.973870 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b79633-b829-4226-a096-e73bfc904e7e None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.974458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b79633-b829-4226-a096-e73bfc904e7e None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.974458 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b79633-b829-4226-a096-e73bfc904e7e None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.975771 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 502/998] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:40.981103 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291553d7-a48b-4acf-9f12-5a45eb844007 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.981591 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291553d7-a48b-4acf-9f12-5a45eb844007 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.981675 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291553d7-a48b-4acf-9f12-5a45eb844007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.003233 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-291553d7-a48b-4acf-9f12-5a45eb844007 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:41.004654 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-291553d7-a48b-4acf-9f12-5a45eb844007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:41.013316 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 497/999] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:41.373405 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b79633-b829-4226-a096-e73bfc904e7e None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.391526 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b79633-b829-4226-a096-e73bfc904e7e None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.396838 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6611bf-9de2-4c6c-ae61-7d80cc16ec46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.397622 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6611bf-9de2-4c6c-ae61-7d80cc16ec46 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.397984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6611bf-9de2-4c6c-ae61-7d80cc16ec46 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.398531 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6611bf-9de2-4c6c-ae61-7d80cc16ec46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.407553 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6611bf-9de2-4c6c-ae61-7d80cc16ec46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.409260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6611bf-9de2-4c6c-ae61-7d80cc16ec46 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.419083 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 503/1000] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:43.645184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07aeb67-708f-4170-a088-d8eb35623283 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:43.645720 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07aeb67-708f-4170-a088-d8eb35623283 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:43.645720 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07aeb67-708f-4170-a088-d8eb35623283 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:43.647322 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 498/1001] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:43.652712 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38327999-cc96-4d5f-afd1-e822a9aaece1 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:43.653452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38327999-cc96-4d5f-afd1-e822a9aaece1 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:43.653862 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38327999-cc96-4d5f-afd1-e822a9aaece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:43.673963 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-38327999-cc96-4d5f-afd1-e822a9aaece1 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:43.675699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-38327999-cc96-4d5f-afd1-e822a9aaece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:43.684002 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 504/1002] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:44.026312 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07aeb67-708f-4170-a088-d8eb35623283 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:44.041381 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07aeb67-708f-4170-a088-d8eb35623283 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:44.046951 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d7ee4-83f2-45eb-81fd-473898010c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:44.047550 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d7ee4-83f2-45eb-81fd-473898010c89 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:44.047865 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d7ee4-83f2-45eb-81fd-473898010c89 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:44.048163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d7ee4-83f2-45eb-81fd-473898010c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:44.057446 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d7ee4-83f2-45eb-81fd-473898010c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:44.059095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d7ee4-83f2-45eb-81fd-473898010c89 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:44.069634 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 499/1003] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:46.331225 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9b3b3-c4cb-472f-94d2-1e8e8ba97bde None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.331768 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9b3b3-c4cb-472f-94d2-1e8e8ba97bde None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.331768 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9b3b3-c4cb-472f-94d2-1e8e8ba97bde None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.333297 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 505/1004] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:46.338522 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c362df6-fc0e-49ed-abe7-cb95ca0a0664 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.338950 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c362df6-fc0e-49ed-abe7-cb95ca0a0664 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.339057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c362df6-fc0e-49ed-abe7-cb95ca0a0664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.358739 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-8c362df6-fc0e-49ed-abe7-cb95ca0a0664 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:46.359953 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-8c362df6-fc0e-49ed-abe7-cb95ca0a0664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:46.368967 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 500/1005] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:46.706781 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9b3b3-c4cb-472f-94d2-1e8e8ba97bde None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:46.721077 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9b3b3-c4cb-472f-94d2-1e8e8ba97bde None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:46.726391 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6c4f0-e754-4fe7-ada9-9f10a02b2e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:46.726983 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c4f0-e754-4fe7-ada9-9f10a02b2e44 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.727259 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c4f0-e754-4fe7-ada9-9f10a02b2e44 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.727526 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c4f0-e754-4fe7-ada9-9f10a02b2e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.736197 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6c4f0-e754-4fe7-ada9-9f10a02b2e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:46.737887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6c4f0-e754-4fe7-ada9-9f10a02b2e44 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:46.747974 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 506/1006] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:48.999987 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c494e-a181-4c19-ac77-26b590f7845b None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.000585 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c494e-a181-4c19-ac77-26b590f7845b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.000700 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c494e-a181-4c19-ac77-26b590f7845b None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.002540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 501/1007] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:49.009752 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a2342-2779-4127-b66e-8cfa86f81194 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.010299 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a2342-2779-4127-b66e-8cfa86f81194 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.010529 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a2342-2779-4127-b66e-8cfa86f81194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.032711 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-790a2342-2779-4127-b66e-8cfa86f81194 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:49.034016 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-790a2342-2779-4127-b66e-8cfa86f81194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:49.042421 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 507/1008] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:49.382448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c494e-a181-4c19-ac77-26b590f7845b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.396899 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c494e-a181-4c19-ac77-26b590f7845b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:49.402353 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4618-9a5d-42e8-a2b1-1db4ca724668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:49.402968 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4618-9a5d-42e8-a2b1-1db4ca724668 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.403247 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4618-9a5d-42e8-a2b1-1db4ca724668 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.403523 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4618-9a5d-42e8-a2b1-1db4ca724668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.413323 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4618-9a5d-42e8-a2b1-1db4ca724668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:49.415168 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4618-9a5d-42e8-a2b1-1db4ca724668 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:49.427228 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 502/1009] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:52.060496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623e5c0-ce02-4456-91eb-2daa198d5a4a None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.061255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623e5c0-ce02-4456-91eb-2daa198d5a4a None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.061255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623e5c0-ce02-4456-91eb-2daa198d5a4a None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.062905 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 508/1010] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:52.069061 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03138eef-7b54-4620-a69b-1835b770c8f2 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.069736 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03138eef-7b54-4620-a69b-1835b770c8f2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.069736 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03138eef-7b54-4620-a69b-1835b770c8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.077849 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=43 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:52.091515 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-03138eef-7b54-4620-a69b-1835b770c8f2 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:52.092748 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-03138eef-7b54-4620-a69b-1835b770c8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:52.102149 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 503/1011] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:52.640111 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623e5c0-ce02-4456-91eb-2daa198d5a4a None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:52.656596 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623e5c0-ce02-4456-91eb-2daa198d5a4a None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:52.662431 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c36013-c827-42d4-9918-a18de7d60839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:52.663039 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c36013-c827-42d4-9918-a18de7d60839 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.663312 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c36013-c827-42d4-9918-a18de7d60839 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.663580 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c36013-c827-42d4-9918-a18de7d60839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.672710 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c36013-c827-42d4-9918-a18de7d60839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:52.674348 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c36013-c827-42d4-9918-a18de7d60839 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:52.684467 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 509/1012] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:55.396849 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072df0-0807-4543-90d4-b913d1897045 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.397530 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072df0-0807-4543-90d4-b913d1897045 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.397530 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072df0-0807-4543-90d4-b913d1897045 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.398773 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 504/1013] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:55.404084 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92b28d-991c-4403-a659-99e6fe7b9cb5 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.404577 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92b28d-991c-4403-a659-99e6fe7b9cb5 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.404577 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92b28d-991c-4403-a659-99e6fe7b9cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.424243 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-fd92b28d-991c-4403-a659-99e6fe7b9cb5 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:55.425825 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-fd92b28d-991c-4403-a659-99e6fe7b9cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:55.434373 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 510/1014] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:55.783129 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072df0-0807-4543-90d4-b913d1897045 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:55.796995 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072df0-0807-4543-90d4-b913d1897045 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:55.802841 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f3578-f124-44e0-b8b4-73e87fe7e22a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:55.803430 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f3578-f124-44e0-b8b4-73e87fe7e22a service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.803706 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f3578-f124-44e0-b8b4-73e87fe7e22a service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.803971 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f3578-f124-44e0-b8b4-73e87fe7e22a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.812570 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f3578-f124-44e0-b8b4-73e87fe7e22a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:55.814450 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f3578-f124-44e0-b8b4-73e87fe7e22a service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:55.824675 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 505/1015] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:57.048334 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34187f-b7b4-4e36-87b4-5ffaf1687b94 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.048949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34187f-b7b4-4e36-87b4-5ffaf1687b94 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.048949 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34187f-b7b4-4e36-87b4-5ffaf1687b94 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.050661 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 511/1016] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:57.056360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7835ba-a8fd-4024-b196-be8a9280c182 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.056818 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7835ba-a8fd-4024-b196-be8a9280c182 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.057016 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7835ba-a8fd-4024-b196-be8a9280c182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.078108 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-fc7835ba-a8fd-4024-b196-be8a9280c182 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:57.079411 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-fc7835ba-a8fd-4024-b196-be8a9280c182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:57.088343 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 506/1017] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:57.445474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd5172-e849-418d-a06f-aa3cbab6f56c None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.445894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd5172-e849-418d-a06f-aa3cbab6f56c None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.446217 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd5172-e849-418d-a06f-aa3cbab6f56c None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.447573 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 512/1018] 10.222.0.47 () {54 vars in 967 bytes} [Tue Aug 23 16:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:57.453165 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f70c2-f351-4f89-ba4c-879721a00e88 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.453455 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f70c2-f351-4f89-ba4c-879721a00e88 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.453717 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f70c2-f351-4f89-ba4c-879721a00e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.494014 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-8e0f70c2-f351-4f89-ba4c-879721a00e88 None None] MFA Rules not processed for user `5ff3c93c8cca444cba0362960b57a6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:57.495239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-8e0f70c2-f351-4f89-ba4c-879721a00e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:57.567433 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 507/1019] 10.222.0.47 () {58 vars in 1064 bytes} [Tue Aug 23 16:15:57 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:57.575180 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd5172-e849-418d-a06f-aa3cbab6f56c None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:57.587564 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd5172-e849-418d-a06f-aa3cbab6f56c None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:57.592114 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d650aef-c5c9-4268-ad29-fbdb5df6d346 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ff3c93c8cca444cba0362960b57a6bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:57.592718 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d650aef-c5c9-4268-ad29-fbdb5df6d346 service glance] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.592996 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d650aef-c5c9-4268-ad29-fbdb5df6d346 service glance] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.593289 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d650aef-c5c9-4268-ad29-fbdb5df6d346 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.603271 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d650aef-c5c9-4268-ad29-fbdb5df6d346 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:57.604714 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d650aef-c5c9-4268-ad29-fbdb5df6d346 service glance] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:57.614864 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 513/1020] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:15:58.053355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644437f3-0e89-47d4-8e7d-7d9334e39b9d None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.053694 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644437f3-0e89-47d4-8e7d-7d9334e39b9d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.053879 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644437f3-0e89-47d4-8e7d-7d9334e39b9d None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:58.055448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 508/1021] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:58.060999 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84332352-ccfc-4b38-bfc8-f2acc4d47e14 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.061573 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84332352-ccfc-4b38-bfc8-f2acc4d47e14 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.061573 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84332352-ccfc-4b38-bfc8-f2acc4d47e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:58.082722 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-84332352-ccfc-4b38-bfc8-f2acc4d47e14 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:58.083967 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-84332352-ccfc-4b38-bfc8-f2acc4d47e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:58.092285 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 514/1022] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:15:58.433483 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644437f3-0e89-47d4-8e7d-7d9334e39b9d None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:58.448932 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644437f3-0e89-47d4-8e7d-7d9334e39b9d None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:58.454201 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e7015-2fbb-4538-856a-a799715d08d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:58.454805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7015-2fbb-4538-856a-a799715d08d5 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.455075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7015-2fbb-4538-856a-a799715d08d5 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.455341 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7015-2fbb-4538-856a-a799715d08d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:58.465766 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e7015-2fbb-4538-856a-a799715d08d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:58.467412 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e7015-2fbb-4538-856a-a799715d08d5 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:58.480517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 509/1023] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:15:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:00.774110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51104aa-417a-4d6b-9c17-76abf1b3a968 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.774787 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51104aa-417a-4d6b-9c17-76abf1b3a968 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.774787 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51104aa-417a-4d6b-9c17-76abf1b3a968 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.775939 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 515/1024] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:00.781430 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f2cd-17dd-444d-a650-20dce2def93f None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.782194 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f2cd-17dd-444d-a650-20dce2def93f None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.782194 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f2cd-17dd-444d-a650-20dce2def93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.803440 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-8c07f2cd-17dd-444d-a650-20dce2def93f None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:00.804781 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-8c07f2cd-17dd-444d-a650-20dce2def93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:00.817646 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 510/1025] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:01.162955 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51104aa-417a-4d6b-9c17-76abf1b3a968 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:01.171158 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=92 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:01.183342 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51104aa-417a-4d6b-9c17-76abf1b3a968 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:01.188799 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b928ab-65f8-446f-ac51-5a7aeaf1b55c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:01.189401 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b928ab-65f8-446f-ac51-5a7aeaf1b55c service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:01.189674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b928ab-65f8-446f-ac51-5a7aeaf1b55c service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:01.189941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b928ab-65f8-446f-ac51-5a7aeaf1b55c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:01.199850 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b928ab-65f8-446f-ac51-5a7aeaf1b55c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:01.201457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b928ab-65f8-446f-ac51-5a7aeaf1b55c service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:01.211507 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 516/1026] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:10.797668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=53 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:11.207223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=5 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:12.909128 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204ae1-86f4-4f0e-a7df-0a3a292220b1 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.909651 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204ae1-86f4-4f0e-a7df-0a3a292220b1 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.909651 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204ae1-86f4-4f0e-a7df-0a3a292220b1 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.911203 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 511/1027] 10.222.0.47 () {54 vars in 918 bytes} [Tue Aug 23 16:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:12.916322 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e900-ed8a-4e12-849c-28195ef8deff None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.916810 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e900-ed8a-4e12-849c-28195ef8deff None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.916918 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e900-ed8a-4e12-849c-28195ef8deff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.938165 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-3a38e900-ed8a-4e12-849c-28195ef8deff None None] MFA Rules not processed for user `19c2519ed2e747e78a2ca91c3625a20d`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:12.939384 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-3a38e900-ed8a-4e12-849c-28195ef8deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:12.949549 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 517/1028] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Aug 23 16:16:12 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:16:12.964027 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e398f-315c-488b-9a15-c6e7838a6217 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.964300 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e398f-315c-488b-9a15-c6e7838a6217 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.964566 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e398f-315c-488b-9a15-c6e7838a6217 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.965883 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 512/1029] 10.222.0.47 () {54 vars in 918 bytes} [Tue Aug 23 16:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:12.970657 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9d36-982e-4e06-ab17-7299492f5abc None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.970933 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9d36-982e-4e06-ab17-7299492f5abc None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.971204 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9d36-982e-4e06-ab17-7299492f5abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.991121 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-c1ab9d36-982e-4e06-ab17-7299492f5abc None None] MFA Rules not processed for user `9c6749b0664141529ce43b78fbc836ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:12.992331 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-c1ab9d36-982e-4e06-ab17-7299492f5abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:13.002941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 518/1030] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Aug 23 16:16:12 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:15.670473 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383d1dd-d99c-4f3c-9f9b-c8ddaaa896fc None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:15.671068 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383d1dd-d99c-4f3c-9f9b-c8ddaaa896fc None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:15.671068 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383d1dd-d99c-4f3c-9f9b-c8ddaaa896fc None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:15.672341 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 513/1031] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:15.679045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeae486-3118-4396-8c78-4bc131281773 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:15.679776 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeae486-3118-4396-8c78-4bc131281773 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:15.680012 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeae486-3118-4396-8c78-4bc131281773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:15.710910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-7aeae486-3118-4396-8c78-4bc131281773 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:15.712108 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-7aeae486-3118-4396-8c78-4bc131281773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:15.721599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 519/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:16:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:16.073225 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383d1dd-d99c-4f3c-9f9b-c8ddaaa896fc None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:16.088344 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383d1dd-d99c-4f3c-9f9b-c8ddaaa896fc None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:16.093808 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b254504-b52b-448a-a928-647a9eeabed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:16.094439 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b254504-b52b-448a-a928-647a9eeabed6 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:16.094717 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b254504-b52b-448a-a928-647a9eeabed6 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:16.094989 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b254504-b52b-448a-a928-647a9eeabed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:16.103559 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b254504-b52b-448a-a928-647a9eeabed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:16.105088 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b254504-b52b-448a-a928-647a9eeabed6 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:16.114588 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 514/1033] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:17.078679 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9f50d-c5e5-4231-a1c0-95eb5f0ae6bc None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.079264 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9f50d-c5e5-4231-a1c0-95eb5f0ae6bc None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.079264 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9f50d-c5e5-4231-a1c0-95eb5f0ae6bc None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.080575 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 520/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:17.086644 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b934b2-5fa9-4651-b5c2-36ab080d8d55 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.087106 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b934b2-5fa9-4651-b5c2-36ab080d8d55 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.087221 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b934b2-5fa9-4651-b5c2-36ab080d8d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.117589 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-16b934b2-5fa9-4651-b5c2-36ab080d8d55 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:17.118823 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-16b934b2-5fa9-4651-b5c2-36ab080d8d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:17.128031 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 515/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:16:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:17.376223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9f50d-c5e5-4231-a1c0-95eb5f0ae6bc None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:17.395206 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9f50d-c5e5-4231-a1c0-95eb5f0ae6bc None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:17.400495 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1aec1-7874-4dc1-a4d1-dea9d90bd423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:17.401087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1aec1-7874-4dc1-a4d1-dea9d90bd423 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.401364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1aec1-7874-4dc1-a4d1-dea9d90bd423 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.401627 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1aec1-7874-4dc1-a4d1-dea9d90bd423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.410711 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1aec1-7874-4dc1-a4d1-dea9d90bd423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:17.412312 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1aec1-7874-4dc1-a4d1-dea9d90bd423 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:17.422728 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 521/1036] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:18.339377 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b91df-7ebe-4ac8-aee5-6eecb5c6fbb9 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:18.339996 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b91df-7ebe-4ac8-aee5-6eecb5c6fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:18.339996 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b91df-7ebe-4ac8-aee5-6eecb5c6fbb9 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:18.341266 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 516/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:18.346364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5599308-28e0-4a21-a85d-01337ccffb26 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:18.347271 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5599308-28e0-4a21-a85d-01337ccffb26 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:18.347547 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5599308-28e0-4a21-a85d-01337ccffb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:18.367869 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-f5599308-28e0-4a21-a85d-01337ccffb26 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:18.369082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-f5599308-28e0-4a21-a85d-01337ccffb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:18.378031 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 522/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:16:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:18.532831 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b91df-7ebe-4ac8-aee5-6eecb5c6fbb9 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:18.547962 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b91df-7ebe-4ac8-aee5-6eecb5c6fbb9 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:18.553970 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe2467-4694-472a-a30f-15614bb92a0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:18.554598 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe2467-4694-472a-a30f-15614bb92a0a service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:18.554874 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe2467-4694-472a-a30f-15614bb92a0a service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:18.555139 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe2467-4694-472a-a30f-15614bb92a0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:18.563379 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe2467-4694-472a-a30f-15614bb92a0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:18.564958 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe2467-4694-472a-a30f-15614bb92a0a service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:18.574463 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 517/1039] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:19.422370 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5b22c-2e18-4cd0-afd4-5af2918b61ac None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:19.422991 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5b22c-2e18-4cd0-afd4-5af2918b61ac None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:19.422991 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5b22c-2e18-4cd0-afd4-5af2918b61ac None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:19.424252 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 523/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:19.430244 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279a10-9f7b-4081-9e9c-5e2e6e525d26 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:19.430729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279a10-9f7b-4081-9e9c-5e2e6e525d26 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:19.430729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279a10-9f7b-4081-9e9c-5e2e6e525d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:19.451023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-18279a10-9f7b-4081-9e9c-5e2e6e525d26 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:19.452230 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-18279a10-9f7b-4081-9e9c-5e2e6e525d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:19.461338 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 518/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:16:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:19.614790 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5b22c-2e18-4cd0-afd4-5af2918b61ac None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:19.629933 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5b22c-2e18-4cd0-afd4-5af2918b61ac None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:19.635561 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc851ec-d18e-4087-b86f-346c6c7dba1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:19.636154 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc851ec-d18e-4087-b86f-346c6c7dba1f service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:19.636425 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc851ec-d18e-4087-b86f-346c6c7dba1f service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:19.636691 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc851ec-d18e-4087-b86f-346c6c7dba1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:19.645126 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc851ec-d18e-4087-b86f-346c6c7dba1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:19.646806 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc851ec-d18e-4087-b86f-346c6c7dba1f service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:19.656157 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 524/1042] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:20.910681 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06bda7-7154-4f10-b988-5aef46994bc4 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:20.911081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06bda7-7154-4f10-b988-5aef46994bc4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:20.911159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06bda7-7154-4f10-b988-5aef46994bc4 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:20.912612 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 519/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:20.917928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66468a1-9146-436d-a20d-b97a6b29ef56 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:20.918398 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66468a1-9146-436d-a20d-b97a6b29ef56 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:20.918510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66468a1-9146-436d-a20d-b97a6b29ef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:20.939621 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-e66468a1-9146-436d-a20d-b97a6b29ef56 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:20.940858 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-e66468a1-9146-436d-a20d-b97a6b29ef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:20.950344 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 525/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:16:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:21.104071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06bda7-7154-4f10-b988-5aef46994bc4 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:21.119619 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06bda7-7154-4f10-b988-5aef46994bc4 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:21.126301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640b3fa-0c38-4aae-bf15-e31c39a7d896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:21.127082 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640b3fa-0c38-4aae-bf15-e31c39a7d896 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.127522 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640b3fa-0c38-4aae-bf15-e31c39a7d896 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.127795 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640b3fa-0c38-4aae-bf15-e31c39a7d896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.142958 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640b3fa-0c38-4aae-bf15-e31c39a7d896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:21.145517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640b3fa-0c38-4aae-bf15-e31c39a7d896 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:21.156314 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 520/1045] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:21.964506 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9731-5e63-4481-be9f-afdb5893c416 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.965122 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9731-5e63-4481-be9f-afdb5893c416 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.965122 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9731-5e63-4481-be9f-afdb5893c416 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.966439 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 526/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:21.972035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ea825-9bca-4448-b1c1-8e2061e3071c None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.972480 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ea825-9bca-4448-b1c1-8e2061e3071c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.972592 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ea825-9bca-4448-b1c1-8e2061e3071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.993866 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-9b9ea825-9bca-4448-b1c1-8e2061e3071c None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:21.995118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-9b9ea825-9bca-4448-b1c1-8e2061e3071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:22.004324 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 521/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:16:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:22.167977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce9731-5e63-4481-be9f-afdb5893c416 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:22.186055 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce9731-5e63-4481-be9f-afdb5893c416 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:22.192744 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7bed4-b77f-4812-bd5b-12f28946e2d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:22.193337 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7bed4-b77f-4812-bd5b-12f28946e2d4 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:22.193612 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7bed4-b77f-4812-bd5b-12f28946e2d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:22.193884 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7bed4-b77f-4812-bd5b-12f28946e2d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:22.202698 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7bed4-b77f-4812-bd5b-12f28946e2d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:22.204406 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7bed4-b77f-4812-bd5b-12f28946e2d4 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:22.215089 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 527/1048] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:23.025773 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcb7d9-a2c7-4ec4-958c-161efe72e18b None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:23.026384 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcb7d9-a2c7-4ec4-958c-161efe72e18b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:23.026384 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcb7d9-a2c7-4ec4-958c-161efe72e18b None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:23.027682 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 522/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:23.032997 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a414a6-0119-433b-816c-f17fdc93768c None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:23.033380 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a414a6-0119-433b-816c-f17fdc93768c None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:23.033575 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a414a6-0119-433b-816c-f17fdc93768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:23.056831 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-a4a414a6-0119-433b-816c-f17fdc93768c None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:23.058034 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-a4a414a6-0119-433b-816c-f17fdc93768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:23.076682 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 528/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:16:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:23.248156 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcb7d9-a2c7-4ec4-958c-161efe72e18b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:23.266947 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcb7d9-a2c7-4ec4-958c-161efe72e18b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:23.273243 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a094d60-6f8f-421b-93d9-ec2cf114522b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:23.273857 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a094d60-6f8f-421b-93d9-ec2cf114522b service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:23.274168 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a094d60-6f8f-421b-93d9-ec2cf114522b service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:23.274435 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a094d60-6f8f-421b-93d9-ec2cf114522b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:23.284255 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a094d60-6f8f-421b-93d9-ec2cf114522b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:23.285895 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a094d60-6f8f-421b-93d9-ec2cf114522b service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:23.296274 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 523/1051] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:24.125882 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24902-99f1-497f-bf6a-ecf340d5db61 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:24.126508 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24902-99f1-497f-bf6a-ecf340d5db61 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:24.126508 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24902-99f1-497f-bf6a-ecf340d5db61 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:24.127814 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 529/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:24.133040 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57322517-38a9-4b1f-86b1-ff532f78f306 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:24.133512 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57322517-38a9-4b1f-86b1-ff532f78f306 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:24.133604 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57322517-38a9-4b1f-86b1-ff532f78f306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:24.154853 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-57322517-38a9-4b1f-86b1-ff532f78f306 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:24.156072 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-57322517-38a9-4b1f-86b1-ff532f78f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:24.165149 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 524/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:16:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:24.320852 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24902-99f1-497f-bf6a-ecf340d5db61 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:24.335915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24902-99f1-497f-bf6a-ecf340d5db61 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:24.341543 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73989807-0da8-4c6b-b2d6-9d29614fd663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:24.342145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73989807-0da8-4c6b-b2d6-9d29614fd663 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:24.342416 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73989807-0da8-4c6b-b2d6-9d29614fd663 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:24.342681 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73989807-0da8-4c6b-b2d6-9d29614fd663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:24.351069 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73989807-0da8-4c6b-b2d6-9d29614fd663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:24.352652 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73989807-0da8-4c6b-b2d6-9d29614fd663 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:24.362248 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 530/1054] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:25.171765 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdbc7d-a9b0-4c9f-83a0-61df3e2f59d4 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:25.172303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdbc7d-a9b0-4c9f-83a0-61df3e2f59d4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:25.172303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdbc7d-a9b0-4c9f-83a0-61df3e2f59d4 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:25.173526 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 525/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:25.179084 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd14a99-de9f-4543-9eda-edd55ca508ff None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:25.179562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd14a99-de9f-4543-9eda-edd55ca508ff None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:25.179691 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd14a99-de9f-4543-9eda-edd55ca508ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:25.200758 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-ddd14a99-de9f-4543-9eda-edd55ca508ff None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:25.201974 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-ddd14a99-de9f-4543-9eda-edd55ca508ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:25.210974 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 531/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:16:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:25.364130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdbc7d-a9b0-4c9f-83a0-61df3e2f59d4 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:25.379761 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdbc7d-a9b0-4c9f-83a0-61df3e2f59d4 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:25.385098 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedd83a-f5fe-4e34-8756-7e4e13c16f2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:25.385697 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedd83a-f5fe-4e34-8756-7e4e13c16f2a service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:25.385973 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedd83a-f5fe-4e34-8756-7e4e13c16f2a service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:25.386267 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedd83a-f5fe-4e34-8756-7e4e13c16f2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:25.395085 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bedd83a-f5fe-4e34-8756-7e4e13c16f2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:25.397379 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bedd83a-f5fe-4e34-8756-7e4e13c16f2a service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:25.409635 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 526/1057] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:27.475943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf059f6f-4f64-4820-b911-38403bc981d7 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.476522 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf059f6f-4f64-4820-b911-38403bc981d7 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.476522 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf059f6f-4f64-4820-b911-38403bc981d7 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.477804 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 532/1058] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:27.483573 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a050110-c15d-4348-8044-61f58a4a8e12 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.484121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a050110-c15d-4348-8044-61f58a4a8e12 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.484121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a050110-c15d-4348-8044-61f58a4a8e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.504642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-2a050110-c15d-4348-8044-61f58a4a8e12 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:27.506155 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-2a050110-c15d-4348-8044-61f58a4a8e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:27.514539 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 527/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:16:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:27.855644 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf059f6f-4f64-4820-b911-38403bc981d7 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:27.868087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf059f6f-4f64-4820-b911-38403bc981d7 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:27.871966 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cecd7a-1ddb-4d55-9e97-887f4b675a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:27.872550 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cecd7a-1ddb-4d55-9e97-887f4b675a8d service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.872824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cecd7a-1ddb-4d55-9e97-887f4b675a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.873088 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cecd7a-1ddb-4d55-9e97-887f4b675a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.882891 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cecd7a-1ddb-4d55-9e97-887f4b675a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:27.884307 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cecd7a-1ddb-4d55-9e97-887f4b675a8d service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:27.894292 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 533/1060] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:16:30.238243 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c5f98-c64d-409a-8fd2-3457c1324437 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:30.238813 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c5f98-c64d-409a-8fd2-3457c1324437 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:30.238813 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c5f98-c64d-409a-8fd2-3457c1324437 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:30.240915 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 528/1061] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:30.247454 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9571d-22e6-40d0-b989-b5cf226f77db None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:30.247910 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9571d-22e6-40d0-b989-b5cf226f77db None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:30.248024 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9571d-22e6-40d0-b989-b5cf226f77db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:30.270852 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-dbb9571d-22e6-40d0-b989-b5cf226f77db None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:30.272055 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-dbb9571d-22e6-40d0-b989-b5cf226f77db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:30.279710 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 534/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:16:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:30.623352 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c5f98-c64d-409a-8fd2-3457c1324437 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:30.643043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c5f98-c64d-409a-8fd2-3457c1324437 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:30.648442 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf5a88-4f2a-4ca7-8937-f2179a78d136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:30.649042 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf5a88-4f2a-4ca7-8937-f2179a78d136 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:30.649317 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf5a88-4f2a-4ca7-8937-f2179a78d136 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:30.649589 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf5a88-4f2a-4ca7-8937-f2179a78d136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:30.659775 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf5a88-4f2a-4ca7-8937-f2179a78d136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:30.661263 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf5a88-4f2a-4ca7-8937-f2179a78d136 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:30.671143 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 529/1063] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:33.179767 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195adfdd-e566-464d-afe8-fdcfa351cbbd None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.180421 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195adfdd-e566-464d-afe8-fdcfa351cbbd None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.180421 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195adfdd-e566-464d-afe8-fdcfa351cbbd None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.181676 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 535/1064] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:33.187452 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2115c9-bb73-4111-aec8-2bd9466afa4e None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.187924 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2115c9-bb73-4111-aec8-2bd9466afa4e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.188019 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2115c9-bb73-4111-aec8-2bd9466afa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.208924 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-5f2115c9-bb73-4111-aec8-2bd9466afa4e None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:33.210234 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-5f2115c9-bb73-4111-aec8-2bd9466afa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:33.219558 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 530/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:16:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:33.572687 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195adfdd-e566-464d-afe8-fdcfa351cbbd None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:33.585165 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195adfdd-e566-464d-afe8-fdcfa351cbbd None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:33.589255 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f251338-143f-42e7-b8b3-80455acc5a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:33.589843 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251338-143f-42e7-b8b3-80455acc5a4a service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.590231 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251338-143f-42e7-b8b3-80455acc5a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.590497 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251338-143f-42e7-b8b3-80455acc5a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.600328 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f251338-143f-42e7-b8b3-80455acc5a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:33.601948 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f251338-143f-42e7-b8b3-80455acc5a4a service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:33.611964 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 536/1066] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:36.019793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c0b8-ca2d-4508-8e72-fae7855a42c4 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:36.020404 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c0b8-ca2d-4508-8e72-fae7855a42c4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:36.020404 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c0b8-ca2d-4508-8e72-fae7855a42c4 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:36.021867 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 531/1067] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:36.027590 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed337573-b7d6-4666-a4ae-1dc3dd17ef85 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:36.028059 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed337573-b7d6-4666-a4ae-1dc3dd17ef85 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:36.028149 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed337573-b7d6-4666-a4ae-1dc3dd17ef85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:36.048212 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-ed337573-b7d6-4666-a4ae-1dc3dd17ef85 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:36.049465 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-ed337573-b7d6-4666-a4ae-1dc3dd17ef85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:36.058422 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 537/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:16:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:36.398254 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c0b8-ca2d-4508-8e72-fae7855a42c4 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:36.411078 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c0b8-ca2d-4508-8e72-fae7855a42c4 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:36.415415 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46582281-71ca-4bf4-a68a-1923e6e0fd13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:36.416000 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46582281-71ca-4bf4-a68a-1923e6e0fd13 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:36.416401 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46582281-71ca-4bf4-a68a-1923e6e0fd13 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:36.416673 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46582281-71ca-4bf4-a68a-1923e6e0fd13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:36.426583 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46582281-71ca-4bf4-a68a-1923e6e0fd13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:36.428135 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46582281-71ca-4bf4-a68a-1923e6e0fd13 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:36.438081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 532/1069] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:38.752210 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c917d-c845-46cd-8a11-a7d9122d11c4 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.752860 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c917d-c845-46cd-8a11-a7d9122d11c4 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.752860 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c917d-c845-46cd-8a11-a7d9122d11c4 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.754517 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 538/1070] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:38.761578 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43db6ba-85cb-417d-bb38-81f306d06103 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.762280 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43db6ba-85cb-417d-bb38-81f306d06103 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.762280 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43db6ba-85cb-417d-bb38-81f306d06103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.782716 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-e43db6ba-85cb-417d-bb38-81f306d06103 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:38.783926 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-e43db6ba-85cb-417d-bb38-81f306d06103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:38.792965 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 533/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:16:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:39.129851 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c917d-c845-46cd-8a11-a7d9122d11c4 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:39.141950 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c917d-c845-46cd-8a11-a7d9122d11c4 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.146658 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993c3ff-fffd-481b-8a18-bea24464496f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.147252 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993c3ff-fffd-481b-8a18-bea24464496f service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.147521 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993c3ff-fffd-481b-8a18-bea24464496f service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.147786 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993c3ff-fffd-481b-8a18-bea24464496f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.156866 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993c3ff-fffd-481b-8a18-bea24464496f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.158319 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993c3ff-fffd-481b-8a18-bea24464496f service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.169095 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 539/1072] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:41.413967 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b4757-e075-49cc-8941-281a23164f4a None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.414661 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b4757-e075-49cc-8941-281a23164f4a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.414661 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b4757-e075-49cc-8941-281a23164f4a None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.416351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 534/1073] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:16:41.422615 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47701022-666a-46cf-b77e-6a30438a3e79 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.423903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47701022-666a-46cf-b77e-6a30438a3e79 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.424399 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47701022-666a-46cf-b77e-6a30438a3e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.434626 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=70 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:41.449647 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-47701022-666a-46cf-b77e-6a30438a3e79 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:41.450900 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-47701022-666a-46cf-b77e-6a30438a3e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:41.460027 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 540/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:16:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:16:41.815958 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b4757-e075-49cc-8941-281a23164f4a None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:41.825304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=64 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:41.832074 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b4757-e075-49cc-8941-281a23164f4a None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:41.836255 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514322a2-0358-4230-a6d8-2df43bf9e946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:41.837101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514322a2-0358-4230-a6d8-2df43bf9e946 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.837409 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514322a2-0358-4230-a6d8-2df43bf9e946 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.837685 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514322a2-0358-4230-a6d8-2df43bf9e946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.848253 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514322a2-0358-4230-a6d8-2df43bf9e946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:41.849711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514322a2-0358-4230-a6d8-2df43bf9e946 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:41.860812 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 535/1075] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:44.128600 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913e344-1b5e-47e7-9212-51e721a43f38 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.129262 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913e344-1b5e-47e7-9212-51e721a43f38 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.129262 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913e344-1b5e-47e7-9212-51e721a43f38 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.130483 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 541/1076] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:44.136043 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be370f-8f69-4cad-ae95-7a3abd657318 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.136496 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be370f-8f69-4cad-ae95-7a3abd657318 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.136610 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be370f-8f69-4cad-ae95-7a3abd657318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.156352 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-14be370f-8f69-4cad-ae95-7a3abd657318 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:44.157558 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-14be370f-8f69-4cad-ae95-7a3abd657318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:44.166187 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 536/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:16:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:44.503783 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913e344-1b5e-47e7-9212-51e721a43f38 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:44.517187 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913e344-1b5e-47e7-9212-51e721a43f38 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:44.521352 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222f25f-e26f-4ed2-ade3-85014417b58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:44.521977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222f25f-e26f-4ed2-ade3-85014417b58d service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.522358 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222f25f-e26f-4ed2-ade3-85014417b58d service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.522629 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222f25f-e26f-4ed2-ade3-85014417b58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.532583 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222f25f-e26f-4ed2-ade3-85014417b58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:44.534088 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222f25f-e26f-4ed2-ade3-85014417b58d service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:44.543657 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 542/1078] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:46.792599 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d64d27-61cf-46ad-8874-91c5bca6088c None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.793479 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d64d27-61cf-46ad-8874-91c5bca6088c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.793479 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d64d27-61cf-46ad-8874-91c5bca6088c None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.795392 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 537/1079] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:16:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:46.801688 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9754df-1881-4179-b8c5-12eec2dfdb21 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.802502 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9754df-1881-4179-b8c5-12eec2dfdb21 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.802674 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9754df-1881-4179-b8c5-12eec2dfdb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.828756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-bb9754df-1881-4179-b8c5-12eec2dfdb21 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:46.829966 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-bb9754df-1881-4179-b8c5-12eec2dfdb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:46.839015 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 543/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:16:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:47.177768 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d64d27-61cf-46ad-8874-91c5bca6088c None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:47.190491 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d64d27-61cf-46ad-8874-91c5bca6088c None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:47.195863 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe43a6c-4d08-46ad-b837-b5ddad770138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:47.196700 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe43a6c-4d08-46ad-b837-b5ddad770138 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:47.197096 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe43a6c-4d08-46ad-b837-b5ddad770138 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:47.197471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe43a6c-4d08-46ad-b837-b5ddad770138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:47.212005 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe43a6c-4d08-46ad-b837-b5ddad770138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:47.213447 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe43a6c-4d08-46ad-b837-b5ddad770138 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:47.223414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 538/1081] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:49.436325 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c687111-f50e-4bf9-82d5-d3c281a72a55 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:49.437779 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c687111-f50e-4bf9-82d5-d3c281a72a55 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:49.438395 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c687111-f50e-4bf9-82d5-d3c281a72a55 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:49.440498 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 544/1082] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:16:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:49.449379 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c06fba-d883-4590-baf5-513e48790359 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:49.449822 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c06fba-d883-4590-baf5-513e48790359 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:49.449921 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c06fba-d883-4590-baf5-513e48790359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:49.474423 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b2c06fba-d883-4590-baf5-513e48790359 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:49.475626 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b2c06fba-d883-4590-baf5-513e48790359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:49.484215 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 539/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:16:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:49.817474 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c687111-f50e-4bf9-82d5-d3c281a72a55 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:49.829395 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c687111-f50e-4bf9-82d5-d3c281a72a55 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:49.833968 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e5f21-0ff6-4744-811e-2836849b6622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:49.834624 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e5f21-0ff6-4744-811e-2836849b6622 service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:49.834896 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e5f21-0ff6-4744-811e-2836849b6622 service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:49.835162 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e5f21-0ff6-4744-811e-2836849b6622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:49.845086 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e5f21-0ff6-4744-811e-2836849b6622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:49.846605 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e5f21-0ff6-4744-811e-2836849b6622 service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:49.856048 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 545/1084] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:16:52.031303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6624e8-585a-42d0-837c-b41df5375a1d None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:52.031889 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6624e8-585a-42d0-837c-b41df5375a1d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:52.031889 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6624e8-585a-42d0-837c-b41df5375a1d None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:52.033851 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 540/1085] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:52.041907 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5c656-837f-47e2-ab8d-8455c26fc02d None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:52.042358 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5c656-837f-47e2-ab8d-8455c26fc02d None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:52.042480 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5c656-837f-47e2-ab8d-8455c26fc02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:52.072322 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-51b5c656-837f-47e2-ab8d-8455c26fc02d None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:52.073782 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-51b5c656-837f-47e2-ab8d-8455c26fc02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:52.083575 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 546/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:16:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:16:52.423446 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6624e8-585a-42d0-837c-b41df5375a1d None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:52.438360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6624e8-585a-42d0-837c-b41df5375a1d None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:52.443263 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ae8db-f928-4394-9bee-ca850fa71809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:52.443850 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ae8db-f928-4394-9bee-ca850fa71809 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:52.444170 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ae8db-f928-4394-9bee-ca850fa71809 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:52.444434 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ae8db-f928-4394-9bee-ca850fa71809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:52.454370 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ae8db-f928-4394-9bee-ca850fa71809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:52.455805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ae8db-f928-4394-9bee-ca850fa71809 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:52.465708 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 541/1087] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:16:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:02.065678 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=20 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:02.461336 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=23 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:16.487507 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f3f44-aa2f-45c1-8518-eaa04e73dc54 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:16.488147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f3f44-aa2f-45c1-8518-eaa04e73dc54 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:16.488147 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f3f44-aa2f-45c1-8518-eaa04e73dc54 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.489424 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 547/1088] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:16.495434 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1462824-df06-4d00-b177-87233b87686c None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:16.495959 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1462824-df06-4d00-b177-87233b87686c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:16.496339 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1462824-df06-4d00-b177-87233b87686c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.522614 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a1462824-df06-4d00-b177-87233b87686c None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:16.524297 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a1462824-df06-4d00-b177-87233b87686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:16.533989 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 542/1089] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:16.893538 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a891b78-7cbb-4c59-9a1b-31e7caf61438 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:16.893815 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a891b78-7cbb-4c59-9a1b-31e7caf61438 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:16.894136 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a891b78-7cbb-4c59-9a1b-31e7caf61438 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.895461 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 548/1090] 10.222.0.47 () {54 vars in 967 bytes} [Tue Aug 23 16:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:16.900934 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73888345-f06a-41e7-8f49-fe13906cf2a3 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:16.901189 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73888345-f06a-41e7-8f49-fe13906cf2a3 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:16.901511 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73888345-f06a-41e7-8f49-fe13906cf2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.922313 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-73888345-f06a-41e7-8f49-fe13906cf2a3 None None] MFA Rules not processed for user `5ff3c93c8cca444cba0362960b57a6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:16.923494 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-73888345-f06a-41e7-8f49-fe13906cf2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:16.931223 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 543/1091] 10.222.0.47 () {58 vars in 1064 bytes} [Tue Aug 23 16:17:16 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:16.939438 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a891b78-7cbb-4c59-9a1b-31e7caf61438 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:16.953400 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a891b78-7cbb-4c59-9a1b-31e7caf61438 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:16.957489 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb26ff-f74a-4c95-a197-ed69b97461df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ff3c93c8cca444cba0362960b57a6bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:16.958150 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb26ff-f74a-4c95-a197-ed69b97461df service glance] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:16.958423 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb26ff-f74a-4c95-a197-ed69b97461df service glance] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:16.958680 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb26ff-f74a-4c95-a197-ed69b97461df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.969506 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb26ff-f74a-4c95-a197-ed69b97461df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:16.970984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb26ff-f74a-4c95-a197-ed69b97461df service glance] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:16.981106 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 549/1092] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:19.253949 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ae8fc-0286-431b-ae36-d21999a98bf4 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.254543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ae8fc-0286-431b-ae36-d21999a98bf4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.254543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ae8fc-0286-431b-ae36-d21999a98bf4 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.255946 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 544/1093] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:19.261617 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd63cf0-79dd-4de1-8305-f19bcc6b6718 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.262076 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd63cf0-79dd-4de1-8305-f19bcc6b6718 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.262191 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd63cf0-79dd-4de1-8305-f19bcc6b6718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.282957 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-6cd63cf0-79dd-4de1-8305-f19bcc6b6718 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:19.284220 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-6cd63cf0-79dd-4de1-8305-f19bcc6b6718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:19.293793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 550/1094] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:19.618268 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ae8fc-0286-431b-ae36-d21999a98bf4 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:19.631172 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ae8fc-0286-431b-ae36-d21999a98bf4 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:19.636042 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71bd1-23b7-4250-ac08-309f08cc6177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:19.636629 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71bd1-23b7-4250-ac08-309f08cc6177 admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.636906 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71bd1-23b7-4250-ac08-309f08cc6177 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.637158 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71bd1-23b7-4250-ac08-309f08cc6177 admin admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.637793 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead71bd1-23b7-4250-ac08-309f08cc6177 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:19.639594 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-ead71bd1-23b7-4250-ac08-309f08cc6177 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:17:19.639594 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: warnings.warn(msg) Aug 23 16:17:19.639594 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: Aug 23 16:17:19.640726 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead71bd1-23b7-4250-ac08-309f08cc6177 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:19.660035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 545/1095] 10.222.0.47 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:19 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:17:21.852264 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2895e-104a-4234-9e53-c9675929b218 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:21.852892 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2895e-104a-4234-9e53-c9675929b218 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:21.852892 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2895e-104a-4234-9e53-c9675929b218 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:21.854247 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 551/1096] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:21.860047 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d311a0-c9e5-4ada-8a83-fea2f8469f50 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:21.860478 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d311a0-c9e5-4ada-8a83-fea2f8469f50 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:21.860587 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d311a0-c9e5-4ada-8a83-fea2f8469f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:21.881035 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-c8d311a0-c9e5-4ada-8a83-fea2f8469f50 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:21.882958 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-c8d311a0-c9e5-4ada-8a83-fea2f8469f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:21.892759 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 546/1097] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:22.250107 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2895e-104a-4234-9e53-c9675929b218 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:22.265407 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2895e-104a-4234-9e53-c9675929b218 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:22.273887 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee1fdc-c2ac-4f85-a616-4640aa1f75c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:22.274686 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee1fdc-c2ac-4f85-a616-4640aa1f75c2 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:22.274958 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee1fdc-c2ac-4f85-a616-4640aa1f75c2 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:22.275223 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee1fdc-c2ac-4f85-a616-4640aa1f75c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:22.283928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee1fdc-c2ac-4f85-a616-4640aa1f75c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:22.285544 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee1fdc-c2ac-4f85-a616-4640aa1f75c2 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:22.298271 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 552/1098] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:24.707216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e606-5c9c-416d-a819-c85a37daa868 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:24.708097 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e606-5c9c-416d-a819-c85a37daa868 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:24.708218 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e606-5c9c-416d-a819-c85a37daa868 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:24.710307 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 547/1099] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:17:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:24.716704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93371a8-e063-4b86-8653-1266de747b7a None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:24.717144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93371a8-e063-4b86-8653-1266de747b7a None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:24.717244 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93371a8-e063-4b86-8653-1266de747b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:24.738148 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-b93371a8-e063-4b86-8653-1266de747b7a None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:24.739376 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-b93371a8-e063-4b86-8653-1266de747b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:24.749452 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 553/1100] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:25.095328 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e606-5c9c-416d-a819-c85a37daa868 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:25.110410 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e606-5c9c-416d-a819-c85a37daa868 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:25.117185 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ec62a-8901-43c1-9c80-4c295b29ad74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:25.117185 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec62a-8901-43c1-9c80-4c295b29ad74 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:25.117185 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec62a-8901-43c1-9c80-4c295b29ad74 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:25.117185 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec62a-8901-43c1-9c80-4c295b29ad74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:25.126394 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ec62a-8901-43c1-9c80-4c295b29ad74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:25.127827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ec62a-8901-43c1-9c80-4c295b29ad74 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:25.138324 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 548/1101] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:27.402558 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421181e-eee1-42dd-98b7-d42934501775 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.403416 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421181e-eee1-42dd-98b7-d42934501775 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.403416 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421181e-eee1-42dd-98b7-d42934501775 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.405470 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 554/1102] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:17:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:27.411818 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47469f5a-1aba-421b-8f2a-c24778c50f84 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.412605 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47469f5a-1aba-421b-8f2a-c24778c50f84 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.412768 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47469f5a-1aba-421b-8f2a-c24778c50f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.434192 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-47469f5a-1aba-421b-8f2a-c24778c50f84 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:27.435393 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-47469f5a-1aba-421b-8f2a-c24778c50f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:27.443661 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 549/1103] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:27.779105 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421181e-eee1-42dd-98b7-d42934501775 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:27.792244 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421181e-eee1-42dd-98b7-d42934501775 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:27.796568 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3e80a-4054-479e-897d-955d825af7ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:27.797159 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3e80a-4054-479e-897d-955d825af7ad service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.797421 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3e80a-4054-479e-897d-955d825af7ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.797678 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3e80a-4054-479e-897d-955d825af7ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.808817 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3e80a-4054-479e-897d-955d825af7ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:27.810258 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3e80a-4054-479e-897d-955d825af7ad service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:27.819505 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 555/1104] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:30.167638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad1f5-9853-4266-931f-69f3946f35c7 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.168437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad1f5-9853-4266-931f-69f3946f35c7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.168437 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad1f5-9853-4266-931f-69f3946f35c7 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.170081 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 550/1105] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:30.176909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79b74-87a3-4f4d-ac10-1927922f6575 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.177509 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79b74-87a3-4f4d-ac10-1927922f6575 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.177509 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79b74-87a3-4f4d-ac10-1927922f6575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.203616 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-2eb79b74-87a3-4f4d-ac10-1927922f6575 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:30.204859 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-2eb79b74-87a3-4f4d-ac10-1927922f6575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:30.214114 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 556/1106] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:30.564526 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad1f5-9853-4266-931f-69f3946f35c7 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:30.579276 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad1f5-9853-4266-931f-69f3946f35c7 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:30.583195 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9600e-ca27-445f-ad29-36af0dfc412f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:30.583803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9600e-ca27-445f-ad29-36af0dfc412f service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.584075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9600e-ca27-445f-ad29-36af0dfc412f service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.584339 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9600e-ca27-445f-ad29-36af0dfc412f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.594767 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9600e-ca27-445f-ad29-36af0dfc412f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:30.596233 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9600e-ca27-445f-ad29-36af0dfc412f service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:30.607177 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 551/1107] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:33.288162 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843d9e-c865-46d1-9807-da77bc20f6af None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.288705 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843d9e-c865-46d1-9807-da77bc20f6af None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.288705 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843d9e-c865-46d1-9807-da77bc20f6af None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.290897 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 557/1108] 10.222.0.47 () {54 vars in 927 bytes} [Tue Aug 23 16:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:33.299999 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39821-2223-4823-85a7-346f64e2ce7a None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.300403 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39821-2223-4823-85a7-346f64e2ce7a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.300635 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39821-2223-4823-85a7-346f64e2ce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.327795 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-5ce39821-2223-4823-85a7-346f64e2ce7a None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:33.329017 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-5ce39821-2223-4823-85a7-346f64e2ce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:33.336824 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 552/1109] 10.222.0.47 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:33.675963 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49843d9e-c865-46d1-9807-da77bc20f6af None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:33.688260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49843d9e-c865-46d1-9807-da77bc20f6af None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:33.692077 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b050d4-dd2b-4d74-8d65-fdc9a0f8476c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:33.692694 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b050d4-dd2b-4d74-8d65-fdc9a0f8476c service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.692965 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b050d4-dd2b-4d74-8d65-fdc9a0f8476c service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.693238 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b050d4-dd2b-4d74-8d65-fdc9a0f8476c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.702296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b050d4-dd2b-4d74-8d65-fdc9a0f8476c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:33.703741 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b050d4-dd2b-4d74-8d65-fdc9a0f8476c service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:33.713126 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 558/1110] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:43.322899 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=33 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:43.708964 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=33 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:48.883274 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f34f2-462a-47ee-ad8d-6a428e4c8d97 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:48.883928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f34f2-462a-47ee-ad8d-6a428e4c8d97 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:48.883928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f34f2-462a-47ee-ad8d-6a428e4c8d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:48.906468 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-907f34f2-462a-47ee-ad8d-6a428e4c8d97 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:48.907672 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-907f34f2-462a-47ee-ad8d-6a428e4c8d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:48.917563 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 553/1111] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:18:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:48.926985 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244ab49-4ba3-48b2-9f97-fcd167351355 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:48.927556 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244ab49-4ba3-48b2-9f97-fcd167351355 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:48.927556 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244ab49-4ba3-48b2-9f97-fcd167351355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:48.952839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-6244ab49-4ba3-48b2-9f97-fcd167351355 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:48.954048 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-6244ab49-4ba3-48b2-9f97-fcd167351355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:48.963953 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 559/1112] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:18:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:48.969309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f34f2-462a-47ee-ad8d-6a428e4c8d97 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:48.980644 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f34f2-462a-47ee-ad8d-6a428e4c8d97 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:48.986881 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9f9c4-7680-45ff-b908-a04d8cf57123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:48.987490 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9f9c4-7680-45ff-b908-a04d8cf57123 admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:48.987761 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9f9c4-7680-45ff-b908-a04d8cf57123 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:48.988070 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9f9c4-7680-45ff-b908-a04d8cf57123 admin admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:48.988656 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9f9c4-7680-45ff-b908-a04d8cf57123 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:18:48.988971 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9f9c4-7680-45ff-b908-a04d8cf57123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:48.989964 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-a9c9f9c4-7680-45ff-b908-a04d8cf57123 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:18:48.989964 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: warnings.warn(msg) Aug 23 16:18:48.989964 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: Aug 23 16:18:48.990874 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9f9c4-7680-45ff-b908-a04d8cf57123 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:49.003787 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 554/1113] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 23 16:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:49.012427 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244ab49-4ba3-48b2-9f97-fcd167351355 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:49.022557 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244ab49-4ba3-48b2-9f97-fcd167351355 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:49.027929 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa96b51-dd64-43ee-8321-6cd6bb76a8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:49.028554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa96b51-dd64-43ee-8321-6cd6bb76a8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.028829 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa96b51-dd64-43ee-8321-6cd6bb76a8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.029101 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa96b51-dd64-43ee-8321-6cd6bb76a8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.029738 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa96b51-dd64-43ee-8321-6cd6bb76a8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:49.031600 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: WARNING py.warnings [None req-2aa96b51-dd64-43ee-8321-6cd6bb76a8d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:18:49.031600 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: warnings.warn(msg) Aug 23 16:18:49.031600 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: Aug 23 16:18:49.032865 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa96b51-dd64-43ee-8321-6cd6bb76a8d2 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:49.065077 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 560/1114] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 23 16:18:49 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:18:49.069827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9f9c4-7680-45ff-b908-a04d8cf57123 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:49.080418 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9f9c4-7680-45ff-b908-a04d8cf57123 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:49.141329 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f3337-e86c-433a-8761-e0d5d4ca27b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:49.141848 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3337-e86c-433a-8761-e0d5d4ca27b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.142163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3337-e86c-433a-8761-e0d5d4ca27b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.142431 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3337-e86c-433a-8761-e0d5d4ca27b1 admin admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.143064 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f3337-e86c-433a-8761-e0d5d4ca27b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:49.144080 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-690f3337-e86c-433a-8761-e0d5d4ca27b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:18:49.144080 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: warnings.warn(msg) Aug 23 16:18:49.144080 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: Aug 23 16:18:49.145290 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f3337-e86c-433a-8761-e0d5d4ca27b1 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:49.168318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 555/1115] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 23 16:18:49 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:18:49.172837 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa96b51-dd64-43ee-8321-6cd6bb76a8d2 admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:49.183765 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa96b51-dd64-43ee-8321-6cd6bb76a8d2 admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:49.189889 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8dab3d-8e61-4483-9c3c-2cf0816e1060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:49.190544 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8dab3d-8e61-4483-9c3c-2cf0816e1060 admin admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.190818 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8dab3d-8e61-4483-9c3c-2cf0816e1060 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.191410 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8dab3d-8e61-4483-9c3c-2cf0816e1060 admin admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.192079 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8dab3d-8e61-4483-9c3c-2cf0816e1060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:49.193128 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: WARNING py.warnings [None req-ff8dab3d-8e61-4483-9c3c-2cf0816e1060 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:18:49.193128 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: warnings.warn(msg) Aug 23 16:18:49.193128 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: Aug 23 16:18:49.194043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8dab3d-8e61-4483-9c3c-2cf0816e1060 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:49.207271 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 561/1116] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 23 16:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:18:49.211521 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f3337-e86c-433a-8761-e0d5d4ca27b1 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:49.221880 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f3337-e86c-433a-8761-e0d5d4ca27b1 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:49.226957 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e384a2a-7a7e-45a6-a2d3-6e7b59951e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:49.227548 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e384a2a-7a7e-45a6-a2d3-6e7b59951e36 admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.227827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e384a2a-7a7e-45a6-a2d3-6e7b59951e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.228094 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e384a2a-7a7e-45a6-a2d3-6e7b59951e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.228746 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e384a2a-7a7e-45a6-a2d3-6e7b59951e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:49.229760 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-2e384a2a-7a7e-45a6-a2d3-6e7b59951e36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:18:49.229760 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: warnings.warn(msg) Aug 23 16:18:49.229760 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: Aug 23 16:18:49.230772 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e384a2a-7a7e-45a6-a2d3-6e7b59951e36 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:49.244125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 556/1117] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 23 16:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:18:49.248940 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8dab3d-8e61-4483-9c3c-2cf0816e1060 admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:49.259548 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8dab3d-8e61-4483-9c3c-2cf0816e1060 admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:49.265539 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe08606-2020-492a-857d-39d2cca464e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:49.266200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe08606-2020-492a-857d-39d2cca464e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.266507 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe08606-2020-492a-857d-39d2cca464e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.266775 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe08606-2020-492a-857d-39d2cca464e5 admin admin] PATH_INFO: `/v3/projects/3536b5d1892f435d8f0ca165d0c95e99/users/2cc928f00e12491687a54291f4a262b0/roles/9e1823c929634538b474878b5a80c62d` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.282872 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe08606-2020-492a-857d-39d2cca464e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3536b5d1892f435d8f0ca165d0c95e99, user_id=2cc928f00e12491687a54291f4a262b0, role_id=9e1823c929634538b474878b5a80c62d)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:49.283962 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: WARNING py.warnings [None req-9fe08606-2020-492a-857d-39d2cca464e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:18:49.283962 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: warnings.warn(msg) Aug 23 16:18:49.283962 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: Aug 23 16:18:49.285862 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe08606-2020-492a-857d-39d2cca464e5 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:49.305066 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 562/1118] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 23 16:18:49 2022] PUT /identity/v3/projects/3536b5d1892f435d8f0ca165d0c95e99/users/2cc928f00e12491687a54291f4a262b0/roles/9e1823c929634538b474878b5a80c62d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:18:49.320586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99f621-05d3-4b52-967c-a7d58c64598e None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.320858 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99f621-05d3-4b52-967c-a7d58c64598e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.321124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99f621-05d3-4b52-967c-a7d58c64598e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.352302 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-0b99f621-05d3-4b52-967c-a7d58c64598e None None] MFA Rules not processed for user `2cc928f00e12491687a54291f4a262b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:49.353520 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-0b99f621-05d3-4b52-967c-a7d58c64598e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:49.420237 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 557/1119] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:18:49 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:49.438309 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc6a44-898b-47c4-9d68-1a362a96fec9 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.438591 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc6a44-898b-47c4-9d68-1a362a96fec9 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.438862 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc6a44-898b-47c4-9d68-1a362a96fec9 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.440816 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 563/1120] 10.222.0.47 () {54 vars in 964 bytes} [Tue Aug 23 16:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:49.447986 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ea05c-eeaf-42d7-b535-f84d0869ee95 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.448269 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ea05c-eeaf-42d7-b535-f84d0869ee95 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.448556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ea05c-eeaf-42d7-b535-f84d0869ee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.470281 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-0b8ea05c-eeaf-42d7-b535-f84d0869ee95 None None] MFA Rules not processed for user `f2225825e32a488ea5bca33c00bb1b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:49.471484 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-0b8ea05c-eeaf-42d7-b535-f84d0869ee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:49.521133 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:49.529972 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 558/1121] 10.222.0.47 () {58 vars in 1061 bytes} [Tue Aug 23 16:18:49 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:18:49.542046 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc6a44-898b-47c4-9d68-1a362a96fec9 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:49.555353 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc6a44-898b-47c4-9d68-1a362a96fec9 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:49.559766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ef100-59e7-40c2-a7f8-4d2e3fc7874b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2225825e32a488ea5bca33c00bb1b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:49.560354 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ef100-59e7-40c2-a7f8-4d2e3fc7874b service cinder] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.560626 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ef100-59e7-40c2-a7f8-4d2e3fc7874b service cinder] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.560886 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ef100-59e7-40c2-a7f8-4d2e3fc7874b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.569858 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ef100-59e7-40c2-a7f8-4d2e3fc7874b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:49.571329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ef100-59e7-40c2-a7f8-4d2e3fc7874b service cinder] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:49.580710 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 564/1122] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:49 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:49.620827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2e43-8d2f-424b-91f7-aff2a51247a0 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.621100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2e43-8d2f-424b-91f7-aff2a51247a0 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.621335 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2e43-8d2f-424b-91f7-aff2a51247a0 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.623355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 559/1123] 10.222.0.47 () {52 vars in 830 bytes} [Tue Aug 23 16:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:49.628162 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ef100-59e7-40c2-a7f8-4d2e3fc7874b service cinder] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:49.708310 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ef100-59e7-40c2-a7f8-4d2e3fc7874b service cinder] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:49.713984 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:49.714640 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.714907 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.715183 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] PATH_INFO: `/v3/users/2cc928f00e12491687a54291f4a262b0` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.716506 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc928f00e12491687a54291f4a262b0)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:49.717576 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: WARNING py.warnings [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:18:49.717576 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: warnings.warn(msg) Aug 23 16:18:49.717576 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: Aug 23 16:18:49.718807 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:49.794517 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc928f00e12491687a54291f4a262b0'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:18:49.817635 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc928f00e12491687a54291f4a262b0'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:18:49.818466 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc928f00e12491687a54291f4a262b0'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:18:49.819082 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc928f00e12491687a54291f4a262b0'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:18:49.832863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc928f00e12491687a54291f4a262b0'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:18:49.853135 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 565/1124] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 23 16:18:49 2022] DELETE /identity/v3/users/2cc928f00e12491687a54291f4a262b0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:18:49.857798 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16a7fd-9280-4dec-b50f-b209df35521d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.858114 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16a7fd-9280-4dec-b50f-b209df35521d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.858414 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16a7fd-9280-4dec-b50f-b209df35521d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.877808 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-0e16a7fd-9280-4dec-b50f-b209df35521d None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:49.879101 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-0e16a7fd-9280-4dec-b50f-b209df35521d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:49.951328 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 560/1125] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:18:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:49.962303 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:49.963753 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:49.969886 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:50.036694 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814276f1-1dcf-4d04-a13b-12cb9db04259 admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:50.041912 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29158682-a92b-4956-b155-76c9f508f264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:50.042562 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29158682-a92b-4956-b155-76c9f508f264 service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:50.042835 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29158682-a92b-4956-b155-76c9f508f264 service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:50.043098 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29158682-a92b-4956-b155-76c9f508f264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:50.054137 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29158682-a92b-4956-b155-76c9f508f264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:50.055593 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29158682-a92b-4956-b155-76c9f508f264 service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:50.065867 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 566/1126] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:50.406543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16a7fd-9280-4dec-b50f-b209df35521d None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:50.408095 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-0e16a7fd-9280-4dec-b50f-b209df35521d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:50.420799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16a7fd-9280-4dec-b50f-b209df35521d None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:50.428136 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:50.428773 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:50.429149 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:50.429300 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] PATH_INFO: `/v3/projects/3536b5d1892f435d8f0ca165d0c95e99` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:50.431751 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3536b5d1892f435d8f0ca165d0c95e99)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:50.432803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:18:50.432803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: warnings.warn(msg) Aug 23 16:18:50.432803 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: Aug 23 16:18:50.434013 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:50.498728 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3536b5d1892f435d8f0ca165d0c95e99', 'request_id': 'req-ae73da8f-15d2-48ac-b9af-5c00f21627ca'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:18:50.510306 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3536b5d1892f435d8f0ca165d0c95e99', 'request_id': 'req-ae73da8f-15d2-48ac-b9af-5c00f21627ca'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:18:50.516584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3536b5d1892f435d8f0ca165d0c95e99', 'request_id': 'req-ae73da8f-15d2-48ac-b9af-5c00f21627ca'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:18:50.535534 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] The token cache is being invalidate because project 3536b5d1892f435d8f0ca165d0c95e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:18:50.535812 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:18:50.536507 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-ae73da8f-15d2-48ac-b9af-5c00f21627ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:18:50.538204 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 561/1127] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 23 16:18:50 2022] DELETE /identity/v3/projects/3536b5d1892f435d8f0ca165d0c95e99 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:19:00.061440 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=25 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:00.532227 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:14.674050 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03084d0d-8a46-473c-8c85-09125df923f0 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:14.675034 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03084d0d-8a46-473c-8c85-09125df923f0 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:14.675034 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03084d0d-8a46-473c-8c85-09125df923f0 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:14.677131 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 567/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:20:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:14.686049 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf0179-202c-4689-a101-66bed9a8b809 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:14.686760 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf0179-202c-4689-a101-66bed9a8b809 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:14.686982 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf0179-202c-4689-a101-66bed9a8b809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:14.774346 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-5faf0179-202c-4689-a101-66bed9a8b809 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:14.775451 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-5faf0179-202c-4689-a101-66bed9a8b809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:14.880923 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 562/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:20:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:15.052691 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03084d0d-8a46-473c-8c85-09125df923f0 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:15.055679 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-03084d0d-8a46-473c-8c85-09125df923f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:15.154464 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03084d0d-8a46-473c-8c85-09125df923f0 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:15.160290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cd638-bbc8-4bf2-9a42-d428a840e017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:15.160901 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cd638-bbc8-4bf2-9a42-d428a840e017 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:15.161175 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cd638-bbc8-4bf2-9a42-d428a840e017 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:15.161446 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cd638-bbc8-4bf2-9a42-d428a840e017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:15.170365 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cd638-bbc8-4bf2-9a42-d428a840e017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:15.171978 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cd638-bbc8-4bf2-9a42-d428a840e017 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:15.182279 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 568/1130] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:16.024239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91f839-86c8-4105-b7eb-c695c0140722 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:16.025221 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91f839-86c8-4105-b7eb-c695c0140722 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:16.025221 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91f839-86c8-4105-b7eb-c695c0140722 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:16.027349 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 563/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:20:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:16.035793 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a5c1f-d2e2-46e4-90dc-8e80327eb370 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:16.037260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a5c1f-d2e2-46e4-90dc-8e80327eb370 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:16.037260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a5c1f-d2e2-46e4-90dc-8e80327eb370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:16.061678 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-331a5c1f-d2e2-46e4-90dc-8e80327eb370 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:16.062962 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-331a5c1f-d2e2-46e4-90dc-8e80327eb370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:16.072548 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 569/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:20:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:16.234159 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91f839-86c8-4105-b7eb-c695c0140722 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:16.257386 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91f839-86c8-4105-b7eb-c695c0140722 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:16.265060 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8031f93-c773-427b-9903-8b204cc5e174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:16.265658 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8031f93-c773-427b-9903-8b204cc5e174 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:16.265925 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8031f93-c773-427b-9903-8b204cc5e174 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:16.266230 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8031f93-c773-427b-9903-8b204cc5e174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:16.274796 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8031f93-c773-427b-9903-8b204cc5e174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:16.276408 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8031f93-c773-427b-9903-8b204cc5e174 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:16.285592 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 564/1133] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:20.472434 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4497a6-dde7-4c64-88a4-88c16009ea01 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:20.473089 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4497a6-dde7-4c64-88a4-88c16009ea01 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:20.473089 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4497a6-dde7-4c64-88a4-88c16009ea01 None None] PATH_INFO: `/v3` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:20.478370 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 570/1134] 10.222.0.27 () {54 vars in 925 bytes} [Tue Aug 23 16:20:20 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:20:20.482225 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4146ab-a161-4903-8406-bd25f82e46fe None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:20.482805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4146ab-a161-4903-8406-bd25f82e46fe None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:20.482805 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4146ab-a161-4903-8406-bd25f82e46fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:20.515093 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-9c4146ab-a161-4903-8406-bd25f82e46fe None None] MFA Rules not processed for user `19c2519ed2e747e78a2ca91c3625a20d`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:20.516309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-9c4146ab-a161-4903-8406-bd25f82e46fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:20.576213 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:20.590844 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 565/1135] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Aug 23 16:20:20 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:26.056131 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=42 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:27.541556 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6ad34-f2e8-4b0d-96a4-7b690789b6a2 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:27.542773 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6ad34-f2e8-4b0d-96a4-7b690789b6a2 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:27.542773 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6ad34-f2e8-4b0d-96a4-7b690789b6a2 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:27.544724 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 571/1136] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:20:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:27.549955 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb63463-5a96-4dd2-8121-fe07b69d64b7 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:27.550490 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb63463-5a96-4dd2-8121-fe07b69d64b7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:27.550490 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb63463-5a96-4dd2-8121-fe07b69d64b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:27.574842 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-6cb63463-5a96-4dd2-8121-fe07b69d64b7 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:27.576459 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-6cb63463-5a96-4dd2-8121-fe07b69d64b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:27.585304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 566/1137] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:20:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:27.743819 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6ad34-f2e8-4b0d-96a4-7b690789b6a2 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:27.765244 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6ad34-f2e8-4b0d-96a4-7b690789b6a2 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:27.773789 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44a467-2c95-4386-bb6f-cd3a05eb264d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:27.775229 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a467-2c95-4386-bb6f-cd3a05eb264d service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:27.775507 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a467-2c95-4386-bb6f-cd3a05eb264d service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:27.775778 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a467-2c95-4386-bb6f-cd3a05eb264d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:27.784762 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44a467-2c95-4386-bb6f-cd3a05eb264d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:27.786450 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44a467-2c95-4386-bb6f-cd3a05eb264d service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:27.796955 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 572/1138] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:28.623663 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263560e4-8941-49f2-abcf-b969c37fa7dc None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:28.624595 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263560e4-8941-49f2-abcf-b969c37fa7dc None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:28.624595 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263560e4-8941-49f2-abcf-b969c37fa7dc None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:28.626932 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 567/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:20:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:28.632650 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bad12-99e6-4456-918b-f645176c5cdc None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:28.633407 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bad12-99e6-4456-918b-f645176c5cdc None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:28.634063 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bad12-99e6-4456-918b-f645176c5cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:28.660513 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-a16bad12-99e6-4456-918b-f645176c5cdc None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:28.661890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-a16bad12-99e6-4456-918b-f645176c5cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:28.671508 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 573/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:20:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:28.832186 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263560e4-8941-49f2-abcf-b969c37fa7dc None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:28.850875 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263560e4-8941-49f2-abcf-b969c37fa7dc None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:28.856757 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5004b60-ad9e-419c-a718-03a6ffe7570a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:28.857381 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5004b60-ad9e-419c-a718-03a6ffe7570a service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:28.857651 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5004b60-ad9e-419c-a718-03a6ffe7570a service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:28.857912 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5004b60-ad9e-419c-a718-03a6ffe7570a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:28.867253 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5004b60-ad9e-419c-a718-03a6ffe7570a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:28.870046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5004b60-ad9e-419c-a718-03a6ffe7570a service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:28.881329 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 568/1141] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:29.685419 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc34f1b-45f4-4258-811a-067788333db7 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:29.686293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc34f1b-45f4-4258-811a-067788333db7 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:29.686293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc34f1b-45f4-4258-811a-067788333db7 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:29.688454 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 574/1142] 10.222.0.47 () {54 vars in 961 bytes} [Tue Aug 23 16:20:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:29.695630 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44288631-48aa-411b-8b08-c6282b631df1 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:29.696109 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44288631-48aa-411b-8b08-c6282b631df1 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:29.696215 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44288631-48aa-411b-8b08-c6282b631df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:29.721560 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-44288631-48aa-411b-8b08-c6282b631df1 None None] MFA Rules not processed for user `19c2519ed2e747e78a2ca91c3625a20d`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:29.722873 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-44288631-48aa-411b-8b08-c6282b631df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:29.734702 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 569/1143] 10.222.0.47 () {58 vars in 1058 bytes} [Tue Aug 23 16:20:29 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:29.743141 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc34f1b-45f4-4258-811a-067788333db7 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:29.763877 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc34f1b-45f4-4258-811a-067788333db7 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:29.769507 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e91842-62fc-409e-a52d-2724e5b9576f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c2519ed2e747e78a2ca91c3625a20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:29.770132 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91842-62fc-409e-a52d-2724e5b9576f service placement] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:29.770411 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91842-62fc-409e-a52d-2724e5b9576f service placement] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:29.770678 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91842-62fc-409e-a52d-2724e5b9576f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:29.780483 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e91842-62fc-409e-a52d-2724e5b9576f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:29.782124 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e91842-62fc-409e-a52d-2724e5b9576f service placement] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:29.794070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 575/1144] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:29 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:33.004184 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031073a-91d7-4fd3-bf7f-4348c74a382d None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:33.004797 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031073a-91d7-4fd3-bf7f-4348c74a382d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:33.004797 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031073a-91d7-4fd3-bf7f-4348c74a382d None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:33.006200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 570/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:33.012612 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56295082-8ac9-4d6c-b937-fb8092a9ab9b None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:33.013376 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56295082-8ac9-4d6c-b937-fb8092a9ab9b None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:33.013520 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56295082-8ac9-4d6c-b937-fb8092a9ab9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:33.037515 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-56295082-8ac9-4d6c-b937-fb8092a9ab9b None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:33.038803 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-56295082-8ac9-4d6c-b937-fb8092a9ab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:33.046970 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 576/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:20:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:33.400154 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031073a-91d7-4fd3-bf7f-4348c74a382d None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:33.403147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-f031073a-91d7-4fd3-bf7f-4348c74a382d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:33.471115 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031073a-91d7-4fd3-bf7f-4348c74a382d None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:33.475705 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf96f62-58d6-413d-a047-8b52bed9419f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:33.476376 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf96f62-58d6-413d-a047-8b52bed9419f service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:33.476649 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf96f62-58d6-413d-a047-8b52bed9419f service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:33.476913 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf96f62-58d6-413d-a047-8b52bed9419f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:33.486969 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf96f62-58d6-413d-a047-8b52bed9419f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:33.488419 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf96f62-58d6-413d-a047-8b52bed9419f service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:33.501425 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 571/1147] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:35.664886 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9e75f-11a9-4cf0-a000-6697cbbdfb2c None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:35.665792 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9e75f-11a9-4cf0-a000-6697cbbdfb2c None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:35.665792 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9e75f-11a9-4cf0-a000-6697cbbdfb2c None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:35.667923 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 577/1148] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:20:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:35.674225 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefefc2a-ff58-4260-9523-f88e50a83300 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:35.674982 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefefc2a-ff58-4260-9523-f88e50a83300 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:35.675144 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefefc2a-ff58-4260-9523-f88e50a83300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:35.704037 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-cefefc2a-ff58-4260-9523-f88e50a83300 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:35.705236 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-cefefc2a-ff58-4260-9523-f88e50a83300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:35.713862 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 572/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:20:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:36.055847 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9e75f-11a9-4cf0-a000-6697cbbdfb2c None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:36.068273 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9e75f-11a9-4cf0-a000-6697cbbdfb2c None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:36.072618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f31f65-b5ef-4e60-b8db-d236a7a84dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:36.073249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f31f65-b5ef-4e60-b8db-d236a7a84dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:36.073522 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f31f65-b5ef-4e60-b8db-d236a7a84dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:36.073789 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f31f65-b5ef-4e60-b8db-d236a7a84dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:36.084577 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f31f65-b5ef-4e60-b8db-d236a7a84dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:36.086103 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f31f65-b5ef-4e60-b8db-d236a7a84dc4 service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:36.096188 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 578/1150] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:39.801011 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534bff-bb8c-480e-aaa6-149ed050f29e None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:39.801899 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534bff-bb8c-480e-aaa6-149ed050f29e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:39.801899 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534bff-bb8c-480e-aaa6-149ed050f29e None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:39.804147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 573/1151] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:20:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:39.809791 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd1631-64d6-438f-b14c-1965cf4165c4 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:39.810286 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd1631-64d6-438f-b14c-1965cf4165c4 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:39.810391 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd1631-64d6-438f-b14c-1965cf4165c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:39.839961 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-48cd1631-64d6-438f-b14c-1965cf4165c4 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:39.841222 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-48cd1631-64d6-438f-b14c-1965cf4165c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:39.850746 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 579/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:20:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:40.421301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b534bff-bb8c-480e-aaa6-149ed050f29e None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:40.423297 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-6b534bff-bb8c-480e-aaa6-149ed050f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:40.487190 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b534bff-bb8c-480e-aaa6-149ed050f29e None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:40.491227 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c4545-a4d7-4959-a29b-f7332dc7c891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2225825e32a488ea5bca33c00bb1b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:40.491765 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4545-a4d7-4959-a29b-f7332dc7c891 service cinder] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:40.492033 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4545-a4d7-4959-a29b-f7332dc7c891 service cinder] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:40.492262 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4545-a4d7-4959-a29b-f7332dc7c891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:40.502439 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c4545-a4d7-4959-a29b-f7332dc7c891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:40.503904 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c4545-a4d7-4959-a29b-f7332dc7c891 service cinder] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:40.514131 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 574/1153] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:42.725468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930fcd9-cabe-4d1d-af94-1ca1475b5699 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:42.726145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930fcd9-cabe-4d1d-af94-1ca1475b5699 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:42.726145 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930fcd9-cabe-4d1d-af94-1ca1475b5699 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:42.727407 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 580/1154] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:42.733779 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bf2a5-1e1a-4119-a989-f1b478bdf074 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:42.734564 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bf2a5-1e1a-4119-a989-f1b478bdf074 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:42.734756 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bf2a5-1e1a-4119-a989-f1b478bdf074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:42.759349 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-864bf2a5-1e1a-4119-a989-f1b478bdf074 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:42.760536 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-864bf2a5-1e1a-4119-a989-f1b478bdf074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:42.768733 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 575/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:20:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:43.335405 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930fcd9-cabe-4d1d-af94-1ca1475b5699 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:43.337292 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-8930fcd9-cabe-4d1d-af94-1ca1475b5699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:43.351609 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930fcd9-cabe-4d1d-af94-1ca1475b5699 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:43.356409 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffec487-9da8-4e24-93ea-8bb5cbd596d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2225825e32a488ea5bca33c00bb1b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:43.357021 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffec487-9da8-4e24-93ea-8bb5cbd596d7 service cinder] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:43.357292 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffec487-9da8-4e24-93ea-8bb5cbd596d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:43.357558 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffec487-9da8-4e24-93ea-8bb5cbd596d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:43.367243 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffec487-9da8-4e24-93ea-8bb5cbd596d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:43.368683 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffec487-9da8-4e24-93ea-8bb5cbd596d7 service cinder] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:43.378722 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 581/1156] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:20:52.754502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=70 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:53.374670 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=33 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:58.483876 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1bde-f66c-443f-9719-9616904a463a None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.484567 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1bde-f66c-443f-9719-9616904a463a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.484567 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1bde-f66c-443f-9719-9616904a463a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.486700 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4766-5f3f-4c3c-b046-7de15f450e94 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.487196 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4766-5f3f-4c3c-b046-7de15f450e94 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.487285 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4766-5f3f-4c3c-b046-7de15f450e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.506350 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-616b1bde-f66c-443f-9719-9616904a463a None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:21:58.507899 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-616b1bde-f66c-443f-9719-9616904a463a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:58.509220 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-887c4766-5f3f-4c3c-b046-7de15f450e94 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:21:58.510991 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-887c4766-5f3f-4c3c-b046-7de15f450e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:58.520983 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 576/1157] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:21:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:21:58.524648 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 582/1158] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:21:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:21:58.532429 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d3e01-16a8-42a9-a727-00f388deab3b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.532688 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d3e01-16a8-42a9-a727-00f388deab3b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.532964 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d3e01-16a8-42a9-a727-00f388deab3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.535360 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f6402-9075-42ae-a84d-674677a195a5 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.535637 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f6402-9075-42ae-a84d-674677a195a5 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.535901 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f6402-9075-42ae-a84d-674677a195a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.554537 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-c58d3e01-16a8-42a9-a727-00f388deab3b None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:21:58.555334 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-f14f6402-9075-42ae-a84d-674677a195a5 None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:21:58.555754 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-c58d3e01-16a8-42a9-a727-00f388deab3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:58.556462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-f14f6402-9075-42ae-a84d-674677a195a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:58.564622 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 577/1159] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:21:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:21:58.565044 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 583/1160] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:21:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:21:58.569594 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d3e01-16a8-42a9-a727-00f388deab3b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.569766 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f6402-9075-42ae-a84d-674677a195a5 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.579672 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f6402-9075-42ae-a84d-674677a195a5 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:58.579853 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d3e01-16a8-42a9-a727-00f388deab3b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:58.584633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53e4a2-8d64-4cc2-81d6-768ee534811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:58.584791 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd884d-c1ac-44a4-927f-c5c68797055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:58.585226 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53e4a2-8d64-4cc2-81d6-768ee534811c admin admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.585404 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd884d-c1ac-44a4-927f-c5c68797055b admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.585510 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53e4a2-8d64-4cc2-81d6-768ee534811c admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.585751 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53e4a2-8d64-4cc2-81d6-768ee534811c admin admin] PATH_INFO: `/v3/domains` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.585845 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd884d-c1ac-44a4-927f-c5c68797055b admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.586115 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd884d-c1ac-44a4-927f-c5c68797055b admin admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.586586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53e4a2-8d64-4cc2-81d6-768ee534811c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:21:58.586758 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd884d-c1ac-44a4-927f-c5c68797055b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:21:58.586882 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53e4a2-8d64-4cc2-81d6-768ee534811c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:58.587058 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd884d-c1ac-44a4-927f-c5c68797055b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:58.587896 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: WARNING py.warnings [None req-ca53e4a2-8d64-4cc2-81d6-768ee534811c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:21:58.587896 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: warnings.warn(msg) Aug 23 16:21:58.587896 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: Aug 23 16:21:58.588642 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd884d-c1ac-44a4-927f-c5c68797055b admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:58.588768 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53e4a2-8d64-4cc2-81d6-768ee534811c admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:58.600517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 578/1161] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 23 16:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:21:58.600694 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 584/1162] 10.222.0.47 () {58 vars in 1153 bytes} [Tue Aug 23 16:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:21:58.608456 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53e4a2-8d64-4cc2-81d6-768ee534811c admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.608580 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd884d-c1ac-44a4-927f-c5c68797055b admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.618769 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53e4a2-8d64-4cc2-81d6-768ee534811c admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:58.618944 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd884d-c1ac-44a4-927f-c5c68797055b admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:58.623499 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615beb53-8a70-4cc4-9ce3-48c89be0a1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:58.623650 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa5152-d464-4147-bbe0-51eee03e50f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:58.624091 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615beb53-8a70-4cc4-9ce3-48c89be0a1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.624210 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5152-d464-4147-bbe0-51eee03e50f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.624362 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5152-d464-4147-bbe0-51eee03e50f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.624467 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615beb53-8a70-4cc4-9ce3-48c89be0a1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.624631 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5152-d464-4147-bbe0-51eee03e50f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.624761 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615beb53-8a70-4cc4-9ce3-48c89be0a1b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.625247 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa5152-d464-4147-bbe0-51eee03e50f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:58.625380 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615beb53-8a70-4cc4-9ce3-48c89be0a1b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:58.626469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-615beb53-8a70-4cc4-9ce3-48c89be0a1b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:21:58.626469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: warnings.warn(msg) Aug 23 16:21:58.626469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: Aug 23 16:21:58.627200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa5152-d464-4147-bbe0-51eee03e50f2 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:58.627961 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615beb53-8a70-4cc4-9ce3-48c89be0a1b3 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:58.666873 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 579/1163] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 23 16:21:58 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:21:58.667079 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 585/1164] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 23 16:21:58 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:21:58.671138 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615beb53-8a70-4cc4-9ce3-48c89be0a1b3 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.674457 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa5152-d464-4147-bbe0-51eee03e50f2 admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.738461 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa5152-d464-4147-bbe0-51eee03e50f2 admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:58.739238 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615beb53-8a70-4cc4-9ce3-48c89be0a1b3 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:58.743094 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6f690-35e2-4a4a-8b20-0bfbce3f60a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:58.743698 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6f690-35e2-4a4a-8b20-0bfbce3f60a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.743972 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6f690-35e2-4a4a-8b20-0bfbce3f60a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.744200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7137ab-a032-4d96-8da4-5fd9a256027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:58.744328 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6f690-35e2-4a4a-8b20-0bfbce3f60a3 admin admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.744807 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7137ab-a032-4d96-8da4-5fd9a256027b admin admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.744911 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6f690-35e2-4a4a-8b20-0bfbce3f60a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:58.745083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7137ab-a032-4d96-8da4-5fd9a256027b admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.745353 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7137ab-a032-4d96-8da4-5fd9a256027b admin admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.745824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: WARNING py.warnings [None req-77a6f690-35e2-4a4a-8b20-0bfbce3f60a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:21:58.745824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: warnings.warn(msg) Aug 23 16:21:58.745824 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: Aug 23 16:21:58.746118 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7137ab-a032-4d96-8da4-5fd9a256027b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:58.747074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6f690-35e2-4a4a-8b20-0bfbce3f60a3 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:58.747941 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7137ab-a032-4d96-8da4-5fd9a256027b admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:58.770476 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 586/1165] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 23 16:21:58 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:21:58.774426 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6f690-35e2-4a4a-8b20-0bfbce3f60a3 admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.775444 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 580/1166] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 23 16:21:58 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:21:58.779492 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7137ab-a032-4d96-8da4-5fd9a256027b admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.787097 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6f690-35e2-4a4a-8b20-0bfbce3f60a3 admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:58.789572 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7137ab-a032-4d96-8da4-5fd9a256027b admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:58.791694 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9f7a4-24ad-46d9-a01a-654e7063439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:58.792288 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9f7a4-24ad-46d9-a01a-654e7063439f admin admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.792563 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9f7a4-24ad-46d9-a01a-654e7063439f admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.792828 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9f7a4-24ad-46d9-a01a-654e7063439f admin admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.793453 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9f7a4-24ad-46d9-a01a-654e7063439f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:58.794371 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a1e59-7dae-4d6c-9a25-37a5646e948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:58.794962 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a1e59-7dae-4d6c-9a25-37a5646e948f admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.795146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9f7a4-24ad-46d9-a01a-654e7063439f admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:58.795252 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a1e59-7dae-4d6c-9a25-37a5646e948f admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.795492 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a1e59-7dae-4d6c-9a25-37a5646e948f admin admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.796125 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a1e59-7dae-4d6c-9a25-37a5646e948f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:58.798274 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a1e59-7dae-4d6c-9a25-37a5646e948f admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:58.805797 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 587/1167] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 23 16:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:21:58.809677 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 581/1168] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 23 16:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:21:58.810057 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9f7a4-24ad-46d9-a01a-654e7063439f admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.813578 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a1e59-7dae-4d6c-9a25-37a5646e948f admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.819601 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9f7a4-24ad-46d9-a01a-654e7063439f admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:58.823303 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a1e59-7dae-4d6c-9a25-37a5646e948f admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:58.824476 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df0dd9-9b0b-47f7-802f-66575cf225d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:58.825087 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df0dd9-9b0b-47f7-802f-66575cf225d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.825355 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df0dd9-9b0b-47f7-802f-66575cf225d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.825621 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df0dd9-9b0b-47f7-802f-66575cf225d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.826260 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df0dd9-9b0b-47f7-802f-66575cf225d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:58.827847 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df0dd9-9b0b-47f7-802f-66575cf225d8 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:58.827988 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793e004-4662-4e5a-ad9d-6dd7f263d7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:58.828450 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793e004-4662-4e5a-ad9d-6dd7f263d7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.828724 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793e004-4662-4e5a-ad9d-6dd7f263d7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.829047 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793e004-4662-4e5a-ad9d-6dd7f263d7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.829687 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793e004-4662-4e5a-ad9d-6dd7f263d7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:58.831286 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793e004-4662-4e5a-ad9d-6dd7f263d7d0 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:58.839995 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 588/1169] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 23 16:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:21:58.841814 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 582/1170] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 23 16:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:21:58.844315 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df0dd9-9b0b-47f7-802f-66575cf225d8 admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.846130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793e004-4662-4e5a-ad9d-6dd7f263d7d0 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.853970 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df0dd9-9b0b-47f7-802f-66575cf225d8 admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:58.855783 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793e004-4662-4e5a-ad9d-6dd7f263d7d0 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:58.858703 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303627c-493c-4e3c-8b18-5f48f7dc1dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:58.859427 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303627c-493c-4e3c-8b18-5f48f7dc1dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.859618 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303627c-493c-4e3c-8b18-5f48f7dc1dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.859859 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303627c-493c-4e3c-8b18-5f48f7dc1dc6 admin admin] PATH_INFO: `/v3/projects/fba3a5b99c054dc4b27f7fe5b0958036/users/c51c8adbc0124a339d136fcf94e11736/roles/9e1823c929634538b474878b5a80c62d` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.861037 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70964f70-027d-430f-89fd-295d2a63ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:58.861706 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70964f70-027d-430f-89fd-295d2a63ff47 admin admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.861984 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70964f70-027d-430f-89fd-295d2a63ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.862307 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70964f70-027d-430f-89fd-295d2a63ff47 admin admin] PATH_INFO: `/v3/projects/3686e57cb5b047f1add0dccdfaa8174b/users/0de1ce496a7547f5844660372c9a5b91/roles/9e1823c929634538b474878b5a80c62d` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.874249 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303627c-493c-4e3c-8b18-5f48f7dc1dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba3a5b99c054dc4b27f7fe5b0958036, user_id=c51c8adbc0124a339d136fcf94e11736, role_id=9e1823c929634538b474878b5a80c62d)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:58.876920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303627c-493c-4e3c-8b18-5f48f7dc1dc6 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:58.877215 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70964f70-027d-430f-89fd-295d2a63ff47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3686e57cb5b047f1add0dccdfaa8174b, user_id=0de1ce496a7547f5844660372c9a5b91, role_id=9e1823c929634538b474878b5a80c62d)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:58.878383 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-70964f70-027d-430f-89fd-295d2a63ff47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:21:58.878383 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: warnings.warn(msg) Aug 23 16:21:58.878383 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: Aug 23 16:21:58.880896 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70964f70-027d-430f-89fd-295d2a63ff47 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:58.891846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 589/1171] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 23 16:21:58 2022] PUT /identity/v3/projects/fba3a5b99c054dc4b27f7fe5b0958036/users/c51c8adbc0124a339d136fcf94e11736/roles/9e1823c929634538b474878b5a80c62d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:21:58.896027 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 583/1172] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 23 16:21:58 2022] PUT /identity/v3/projects/3686e57cb5b047f1add0dccdfaa8174b/users/0de1ce496a7547f5844660372c9a5b91/roles/9e1823c929634538b474878b5a80c62d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:21:58.897451 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30eb2-f5e5-49b7-8d37-d20ae5653c8d None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.897735 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30eb2-f5e5-49b7-8d37-d20ae5653c8d None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.898169 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30eb2-f5e5-49b7-8d37-d20ae5653c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.900693 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1c0ca-f60c-4a8b-b684-e788300d0ced None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:58.900977 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1c0ca-f60c-4a8b-b684-e788300d0ced None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:58.901251 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1c0ca-f60c-4a8b-b684-e788300d0ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:58.917296 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-bbb30eb2-f5e5-49b7-8d37-d20ae5653c8d None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:21:58.918567 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-bbb30eb2-f5e5-49b7-8d37-d20ae5653c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:58.919186 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b2d1c0ca-f60c-4a8b-b684-e788300d0ced None None] MFA Rules not processed for user `e029965b87334204be7b0f6baa7febea`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:21:58.920358 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b2d1c0ca-f60c-4a8b-b684-e788300d0ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:58.965488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:58.967147 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:58.984534 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 590/1173] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:21:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:21:58.988771 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 584/1174] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:21:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:21:58.998337 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30eb2-f5e5-49b7-8d37-d20ae5653c8d None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:58.998995 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1c0ca-f60c-4a8b-b684-e788300d0ced None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:59.000710 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b2d1c0ca-f60c-4a8b-b684-e788300d0ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:59.057008 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30eb2-f5e5-49b7-8d37-d20ae5653c8d None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:59.061241 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade614fd-d7f6-42cf-b8ac-86882cffafd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:59.061836 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade614fd-d7f6-42cf-b8ac-86882cffafd5 service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:59.062144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade614fd-d7f6-42cf-b8ac-86882cffafd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:59.063294 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade614fd-d7f6-42cf-b8ac-86882cffafd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:59.071535 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1c0ca-f60c-4a8b-b684-e788300d0ced None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:59.072146 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade614fd-d7f6-42cf-b8ac-86882cffafd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:59.073530 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade614fd-d7f6-42cf-b8ac-86882cffafd5 service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:59.075234 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28385b3b-c2b4-4350-95de-bd11a70048f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:59.075829 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28385b3b-c2b4-4350-95de-bd11a70048f7 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:59.076100 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28385b3b-c2b4-4350-95de-bd11a70048f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:59.076365 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28385b3b-c2b4-4350-95de-bd11a70048f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:59.083324 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 591/1175] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:21:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:21:59.086167 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28385b3b-c2b4-4350-95de-bd11a70048f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:59.087425 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28385b3b-c2b4-4350-95de-bd11a70048f7 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:59.097471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 585/1176] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:21:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:22:04.225429 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127deb98-1d0f-4c54-96ad-560787dbd0dc None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:04.226071 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127deb98-1d0f-4c54-96ad-560787dbd0dc None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:04.228210 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127deb98-1d0f-4c54-96ad-560787dbd0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:04.279085 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-127deb98-1d0f-4c54-96ad-560787dbd0dc None None] MFA Rules not processed for user `c51c8adbc0124a339d136fcf94e11736`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:04.281152 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-127deb98-1d0f-4c54-96ad-560787dbd0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:04.390465 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 592/1177] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:22:04 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:22:04.394531 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28385b3b-c2b4-4350-95de-bd11a70048f7 service neutron] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:04.406102 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28385b3b-c2b4-4350-95de-bd11a70048f7 service neutron] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:04.411770 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bec73-297e-40e1-b593-e89428435b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:04.412569 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bec73-297e-40e1-b593-e89428435b7d admin admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:04.412948 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bec73-297e-40e1-b593-e89428435b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:04.413338 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bec73-297e-40e1-b593-e89428435b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:04.414570 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bec73-297e-40e1-b593-e89428435b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:04.416720 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bec73-297e-40e1-b593-e89428435b7d admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:04.456518 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 586/1178] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 23 16:22:04 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:22:04.460484 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127deb98-1d0f-4c54-96ad-560787dbd0dc None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:04.472629 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127deb98-1d0f-4c54-96ad-560787dbd0dc None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:04.571086 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c3f4e-93f5-46ff-a521-7ec9811e21c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:04.578613 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c3f4e-93f5-46ff-a521-7ec9811e21c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:04.579502 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c3f4e-93f5-46ff-a521-7ec9811e21c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:04.581062 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c3f4e-93f5-46ff-a521-7ec9811e21c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:04.582676 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c3f4e-93f5-46ff-a521-7ec9811e21c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:04.584980 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c3f4e-93f5-46ff-a521-7ec9811e21c0 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:04.619203 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 593/1179] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 23 16:22:04 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:22:04.623008 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bec73-297e-40e1-b593-e89428435b7d admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:04.637024 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bec73-297e-40e1-b593-e89428435b7d admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:04.643212 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca769e-fd54-4abf-830c-ae713acb8966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:04.644163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca769e-fd54-4abf-830c-ae713acb8966 admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:04.644638 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca769e-fd54-4abf-830c-ae713acb8966 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:04.645098 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca769e-fd54-4abf-830c-ae713acb8966 admin admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:04.645756 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca769e-fd54-4abf-830c-ae713acb8966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:04.647763 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca769e-fd54-4abf-830c-ae713acb8966 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:04.668515 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 587/1180] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 23 16:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:22:04.669895 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c3f4e-93f5-46ff-a521-7ec9811e21c0 admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:04.684524 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c3f4e-93f5-46ff-a521-7ec9811e21c0 admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:04.692295 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bbc94-f587-43ab-b3be-9cfbeec93f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:04.692927 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bbc94-f587-43ab-b3be-9cfbeec93f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:04.693207 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bbc94-f587-43ab-b3be-9cfbeec93f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:04.693480 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bbc94-f587-43ab-b3be-9cfbeec93f77 admin admin] PATH_INFO: `/v3/projects/796119e8036540acabd74d427b7b19c4/users/cd3eb43104f047cfbb467bd02033bd0c/roles/5756384fa8d842139e2f1fc44c5088bd` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:04.698998 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:22:04.730098 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bbc94-f587-43ab-b3be-9cfbeec93f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796119e8036540acabd74d427b7b19c4, user_id=cd3eb43104f047cfbb467bd02033bd0c, role_id=5756384fa8d842139e2f1fc44c5088bd)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:04.734085 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bbc94-f587-43ab-b3be-9cfbeec93f77 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:04.756533 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 594/1181] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 23 16:22:04 2022] PUT /identity/v3/projects/796119e8036540acabd74d427b7b19c4/users/cd3eb43104f047cfbb467bd02033bd0c/roles/5756384fa8d842139e2f1fc44c5088bd => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:22:04.758089 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca769e-fd54-4abf-830c-ae713acb8966 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:04.767492 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f621f71-d497-4b72-8de8-2ff309a875cd None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:04.768257 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f621f71-d497-4b72-8de8-2ff309a875cd None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:04.769218 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f621f71-d497-4b72-8de8-2ff309a875cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:04.769795 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca769e-fd54-4abf-830c-ae713acb8966 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:04.818346 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-6f621f71-d497-4b72-8de8-2ff309a875cd None None] MFA Rules not processed for user `0de1ce496a7547f5844660372c9a5b91`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:04.820360 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-6f621f71-d497-4b72-8de8-2ff309a875cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:04.849482 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886851c-0a5e-4298-8065-32fb6426dc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:04.850145 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886851c-0a5e-4298-8065-32fb6426dc2a admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:04.850421 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886851c-0a5e-4298-8065-32fb6426dc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:04.850775 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886851c-0a5e-4298-8065-32fb6426dc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:04.851421 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886851c-0a5e-4298-8065-32fb6426dc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:04.853032 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886851c-0a5e-4298-8065-32fb6426dc2a admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:04.865309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 588/1182] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 23 16:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:22:04.868764 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886851c-0a5e-4298-8065-32fb6426dc2a admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:04.879732 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886851c-0a5e-4298-8065-32fb6426dc2a admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:04.886415 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399af030-8905-482f-ba96-56ad92daff31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:04.887491 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399af030-8905-482f-ba96-56ad92daff31 admin admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:04.887942 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399af030-8905-482f-ba96-56ad92daff31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:04.888314 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399af030-8905-482f-ba96-56ad92daff31 admin admin] PATH_INFO: `/v3/projects/796119e8036540acabd74d427b7b19c4/users/cd3eb43104f047cfbb467bd02033bd0c/roles/5756384fa8d842139e2f1fc44c5088bd` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:04.890323 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399af030-8905-482f-ba96-56ad92daff31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796119e8036540acabd74d427b7b19c4, user_id=cd3eb43104f047cfbb467bd02033bd0c, role_id=5756384fa8d842139e2f1fc44c5088bd)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:04.893143 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399af030-8905-482f-ba96-56ad92daff31 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:04.908326 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 595/1183] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:22:04 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:22:04.908520 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 589/1184] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 23 16:22:04 2022] PUT /identity/v3/projects/796119e8036540acabd74d427b7b19c4/users/cd3eb43104f047cfbb467bd02033bd0c/roles/5756384fa8d842139e2f1fc44c5088bd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:22:04.910313 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f621f71-d497-4b72-8de8-2ff309a875cd None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:04.923159 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f621f71-d497-4b72-8de8-2ff309a875cd None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:04.990928 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe748bc-6b78-462f-87e2-2ec55a44b862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:04.991550 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe748bc-6b78-462f-87e2-2ec55a44b862 admin admin] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:04.991825 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe748bc-6b78-462f-87e2-2ec55a44b862 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:04.992110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe748bc-6b78-462f-87e2-2ec55a44b862 admin admin] PATH_INFO: `/v3/projects` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:04.992761 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe748bc-6b78-462f-87e2-2ec55a44b862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:04.995157 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe748bc-6b78-462f-87e2-2ec55a44b862 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:05.034227 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 596/1185] 10.222.0.47 () {60 vars in 1153 bytes} [Tue Aug 23 16:22:04 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:22:05.036277 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399af030-8905-482f-ba96-56ad92daff31 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:05.051057 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399af030-8905-482f-ba96-56ad92daff31 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:05.086603 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:22:05.168207 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3cbd7-80be-437b-8b83-72b6928d660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:05.169213 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3cbd7-80be-437b-8b83-72b6928d660d admin admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:05.169495 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3cbd7-80be-437b-8b83-72b6928d660d admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:05.170075 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3cbd7-80be-437b-8b83-72b6928d660d admin admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:05.170809 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3cbd7-80be-437b-8b83-72b6928d660d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:05.174036 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3cbd7-80be-437b-8b83-72b6928d660d admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:05.218092 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 590/1186] 10.222.0.47 () {60 vars in 1144 bytes} [Tue Aug 23 16:22:05 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:22:05.219909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe748bc-6b78-462f-87e2-2ec55a44b862 admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:05.235643 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe748bc-6b78-462f-87e2-2ec55a44b862 admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:05.240909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee12d-8371-4c39-9483-bb5ed4e07e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:05.241777 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee12d-8371-4c39-9483-bb5ed4e07e19 admin admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:05.242230 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee12d-8371-4c39-9483-bb5ed4e07e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:05.242568 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee12d-8371-4c39-9483-bb5ed4e07e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:05.243226 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aee12d-8371-4c39-9483-bb5ed4e07e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:05.244890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aee12d-8371-4c39-9483-bb5ed4e07e19 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:05.267151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 597/1187] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 23 16:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:22:05.269540 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3cbd7-80be-437b-8b83-72b6928d660d admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:05.286413 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3cbd7-80be-437b-8b83-72b6928d660d admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:05.291804 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b128f4-b97d-4105-80df-d1868570d8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:05.292668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b128f4-b97d-4105-80df-d1868570d8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:05.293205 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b128f4-b97d-4105-80df-d1868570d8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:05.293482 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b128f4-b97d-4105-80df-d1868570d8e8 admin admin] PATH_INFO: `/v3/projects/ae4ccfc0294447ebb3d68dd0b971b5b4/users/7689a631b7a3434583c5bed51eb9df18/roles/5756384fa8d842139e2f1fc44c5088bd` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:05.324105 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b128f4-b97d-4105-80df-d1868570d8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4ccfc0294447ebb3d68dd0b971b5b4, user_id=7689a631b7a3434583c5bed51eb9df18, role_id=5756384fa8d842139e2f1fc44c5088bd)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:05.327408 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b128f4-b97d-4105-80df-d1868570d8e8 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:05.377643 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 591/1188] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 23 16:22:05 2022] PUT /identity/v3/projects/ae4ccfc0294447ebb3d68dd0b971b5b4/users/7689a631b7a3434583c5bed51eb9df18/roles/5756384fa8d842139e2f1fc44c5088bd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:22:05.378657 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee12d-8371-4c39-9483-bb5ed4e07e19 admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:05.390820 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee12d-8371-4c39-9483-bb5ed4e07e19 admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:05.461200 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:22:05.474282 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4c583-754a-44c0-bbe4-b46a52a86a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:05.475219 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4c583-754a-44c0-bbe4-b46a52a86a90 admin admin] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:05.475555 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4c583-754a-44c0-bbe4-b46a52a86a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:05.475883 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4c583-754a-44c0-bbe4-b46a52a86a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:05.476665 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4c583-754a-44c0-bbe4-b46a52a86a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:05.478872 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4c583-754a-44c0-bbe4-b46a52a86a90 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:05.495154 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b128f4-b97d-4105-80df-d1868570d8e8 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:05.496197 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 598/1189] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 23 16:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:22:05.513922 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b128f4-b97d-4105-80df-d1868570d8e8 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:05.520430 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87627f2-940d-4c71-8f10-b818cebbf878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:05.521689 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87627f2-940d-4c71-8f10-b818cebbf878 admin admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:05.522633 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87627f2-940d-4c71-8f10-b818cebbf878 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:05.523099 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87627f2-940d-4c71-8f10-b818cebbf878 admin admin] PATH_INFO: `/v3/projects/ae4ccfc0294447ebb3d68dd0b971b5b4/users/7689a631b7a3434583c5bed51eb9df18/roles/5756384fa8d842139e2f1fc44c5088bd` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:05.525227 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87627f2-940d-4c71-8f10-b818cebbf878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4ccfc0294447ebb3d68dd0b971b5b4, user_id=7689a631b7a3434583c5bed51eb9df18, role_id=5756384fa8d842139e2f1fc44c5088bd)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:05.530625 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87627f2-940d-4c71-8f10-b818cebbf878 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:05.559351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 592/1190] 10.222.0.47 () {60 vars in 1483 bytes} [Tue Aug 23 16:22:05 2022] PUT /identity/v3/projects/ae4ccfc0294447ebb3d68dd0b971b5b4/users/7689a631b7a3434583c5bed51eb9df18/roles/5756384fa8d842139e2f1fc44c5088bd => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:22:11.903917 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b449593-7937-45b1-b3e0-f8db8739913b None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:11.904569 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b449593-7937-45b1-b3e0-f8db8739913b None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:11.904909 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b449593-7937-45b1-b3e0-f8db8739913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:11.952699 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-9b449593-7937-45b1-b3e0-f8db8739913b None None] MFA Rules not processed for user `cd3eb43104f047cfbb467bd02033bd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:11.954104 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-9b449593-7937-45b1-b3e0-f8db8739913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:12.115578 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 599/1191] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:22:11 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:22:12.129565 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87627f2-940d-4c71-8f10-b818cebbf878 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:12.136486 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-f87627f2-940d-4c71-8f10-b818cebbf878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:12.266609 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87627f2-940d-4c71-8f10-b818cebbf878 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:12.274636 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693ca6c-ed04-4598-b8a7-07c873c7f28f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ff3c93c8cca444cba0362960b57a6bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:12.275263 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693ca6c-ed04-4598-b8a7-07c873c7f28f service glance] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:12.275534 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693ca6c-ed04-4598-b8a7-07c873c7f28f service glance] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:12.275804 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693ca6c-ed04-4598-b8a7-07c873c7f28f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:12.290417 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27b49b-9b8e-4fa5-aa17-3bc901bcd553 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:12.290882 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27b49b-9b8e-4fa5-aa17-3bc901bcd553 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:12.291363 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27b49b-9b8e-4fa5-aa17-3bc901bcd553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:12.345203 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-ae27b49b-9b8e-4fa5-aa17-3bc901bcd553 None None] MFA Rules not processed for user `7689a631b7a3434583c5bed51eb9df18`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:12.347478 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-ae27b49b-9b8e-4fa5-aa17-3bc901bcd553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:12.410054 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693ca6c-ed04-4598-b8a7-07c873c7f28f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:12.413098 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693ca6c-ed04-4598-b8a7-07c873c7f28f service glance] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:12.425363 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 593/1192] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:22:12 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:22:12.466894 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 600/1193] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:22:12 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:22:12.481258 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693ca6c-ed04-4598-b8a7-07c873c7f28f service glance] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:12.482954 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a693ca6c-ed04-4598-b8a7-07c873c7f28f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:12.521715 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693ca6c-ed04-4598-b8a7-07c873c7f28f service glance] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:12.527273 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266f7f7-e026-4755-9159-449518c8acc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ff3c93c8cca444cba0362960b57a6bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:12.527927 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266f7f7-e026-4755-9159-449518c8acc7 service glance] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:12.528428 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266f7f7-e026-4755-9159-449518c8acc7 service glance] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:12.528712 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266f7f7-e026-4755-9159-449518c8acc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:12.575288 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:22:12.639837 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266f7f7-e026-4755-9159-449518c8acc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:12.641613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266f7f7-e026-4755-9159-449518c8acc7 service glance] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:12.659343 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 594/1194] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:22:12 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:22:20.583396 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f874-de65-4fc8-b110-4b446f6beef3 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:20.584084 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f874-de65-4fc8-b110-4b446f6beef3 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:20.584084 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f874-de65-4fc8-b110-4b446f6beef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:20.613069 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-6775f874-de65-4fc8-b110-4b446f6beef3 None None] MFA Rules not processed for user `0de1ce496a7547f5844660372c9a5b91`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:20.614604 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-6775f874-de65-4fc8-b110-4b446f6beef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:20.623621 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 601/1195] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:22:20 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:22:20.934912 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8b72-e6c5-4d07-b9d2-dfb02091943d None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:20.935610 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8b72-e6c5-4d07-b9d2-dfb02091943d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:20.935610 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8b72-e6c5-4d07-b9d2-dfb02091943d None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:20.936945 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 595/1196] 10.222.0.47 () {54 vars in 962 bytes} [Tue Aug 23 16:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:22:20.944977 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301105dd-afe0-4e76-a88e-dddc16fc1692 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:20.945259 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301105dd-afe0-4e76-a88e-dddc16fc1692 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:20.945547 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301105dd-afe0-4e76-a88e-dddc16fc1692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:21.003233 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-301105dd-afe0-4e76-a88e-dddc16fc1692 None None] MFA Rules not processed for user `9c6749b0664141529ce43b78fbc836ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:21.005413 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-301105dd-afe0-4e76-a88e-dddc16fc1692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:21.055047 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=100 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:22:21.113290 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1b407-3ef5-4d4a-a1ae-8552a46c00a9 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:21.113584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1b407-3ef5-4d4a-a1ae-8552a46c00a9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:21.113842 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1b407-3ef5-4d4a-a1ae-8552a46c00a9 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:21.115405 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 596/1197] 10.222.0.47 () {54 vars in 912 bytes} [Tue Aug 23 16:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:22:21.120855 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455441-629b-4b65-9f76-e6f7d8012056 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:21.121136 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455441-629b-4b65-9f76-e6f7d8012056 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:21.121711 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455441-629b-4b65-9f76-e6f7d8012056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:21.122144 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 602/1198] 10.222.0.47 () {58 vars in 1059 bytes} [Tue Aug 23 16:22:20 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:22:21.151939 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a2455441-629b-4b65-9f76-e6f7d8012056 None None] MFA Rules not processed for user `9c6749b0664141529ce43b78fbc836ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:21.153182 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a2455441-629b-4b65-9f76-e6f7d8012056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:21.164028 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 597/1199] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 23 16:22:21 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:22:21.183347 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301105dd-afe0-4e76-a88e-dddc16fc1692 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:21.195842 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301105dd-afe0-4e76-a88e-dddc16fc1692 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:21.200576 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b98571-f2c2-4ebd-98ae-37552e2ae51e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ff3c93c8cca444cba0362960b57a6bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:21.201193 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b98571-f2c2-4ebd-98ae-37552e2ae51e service glance] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:21.201465 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b98571-f2c2-4ebd-98ae-37552e2ae51e service glance] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:21.201833 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b98571-f2c2-4ebd-98ae-37552e2ae51e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:21.216725 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b98571-f2c2-4ebd-98ae-37552e2ae51e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:21.218243 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b98571-f2c2-4ebd-98ae-37552e2ae51e service glance] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:21.232799 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 603/1200] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:22:21 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:22:21.724038 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554da84-1ea4-4669-90ec-09918878aea0 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:21.724318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554da84-1ea4-4669-90ec-09918878aea0 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:21.724618 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554da84-1ea4-4669-90ec-09918878aea0 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:21.725956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 598/1201] 10.222.0.47 () {54 vars in 912 bytes} [Tue Aug 23 16:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:22:21.731678 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff16b1-98f2-4293-b6a0-35026037d2a2 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:21.732226 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff16b1-98f2-4293-b6a0-35026037d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:21.732226 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff16b1-98f2-4293-b6a0-35026037d2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:21.754091 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-16ff16b1-98f2-4293-b6a0-35026037d2a2 None None] MFA Rules not processed for user `2562343e356e47fc86503e2b9cfa0269`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:21.755329 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-16ff16b1-98f2-4293-b6a0-35026037d2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:21.821567 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 604/1202] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 23 16:22:21 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:22:21.834191 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554da84-1ea4-4669-90ec-09918878aea0 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:21.849496 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554da84-1ea4-4669-90ec-09918878aea0 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:21.853366 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db74b58-0ecc-4eff-ba1f-e2dd0e922ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:21.854644 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db74b58-0ecc-4eff-ba1f-e2dd0e922ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:21.854960 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db74b58-0ecc-4eff-ba1f-e2dd0e922ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:21.855284 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db74b58-0ecc-4eff-ba1f-e2dd0e922ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:21.865870 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db74b58-0ecc-4eff-ba1f-e2dd0e922ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:21.868225 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db74b58-0ecc-4eff-ba1f-e2dd0e922ba3 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:21.881971 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 599/1203] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:22:21 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:22:22.346886 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15e4ca-db6f-4bc4-8819-01ef81196e1d None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:22.347262 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15e4ca-db6f-4bc4-8819-01ef81196e1d None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:22.347636 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15e4ca-db6f-4bc4-8819-01ef81196e1d None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:22.349240 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 605/1204] 10.222.0.47 () {54 vars in 962 bytes} [Tue Aug 23 16:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:22:22.358771 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dacc11-d64e-4137-90ad-fdab3d6549b7 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:22.359835 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dacc11-d64e-4137-90ad-fdab3d6549b7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:22.360112 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dacc11-d64e-4137-90ad-fdab3d6549b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:22.360685 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15e4ca-db6f-4bc4-8819-01ef81196e1d None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:22.389122 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-98dacc11-d64e-4137-90ad-fdab3d6549b7 None None] MFA Rules not processed for user `9c6749b0664141529ce43b78fbc836ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:22.391158 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-98dacc11-d64e-4137-90ad-fdab3d6549b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:22.405337 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 600/1205] 10.222.0.47 () {58 vars in 1059 bytes} [Tue Aug 23 16:22:22 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:22:22.411315 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d4ca8-5176-4b5b-b46f-64cb8454a3ef None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:22.411595 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d4ca8-5176-4b5b-b46f-64cb8454a3ef None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:22.411900 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d4ca8-5176-4b5b-b46f-64cb8454a3ef None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:22.413326 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 601/1206] 10.222.0.47 () {54 vars in 912 bytes} [Tue Aug 23 16:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:22:22.425263 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb260030-3f88-466a-bb42-f1c777782154 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:22.425939 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb260030-3f88-466a-bb42-f1c777782154 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:22.426399 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb260030-3f88-466a-bb42-f1c777782154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:22.453522 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-fb260030-3f88-466a-bb42-f1c777782154 None None] MFA Rules not processed for user `9c6749b0664141529ce43b78fbc836ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:22.454815 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-fb260030-3f88-466a-bb42-f1c777782154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:22.470713 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 602/1207] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 23 16:22:22 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:22:22.478667 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15e4ca-db6f-4bc4-8819-01ef81196e1d None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:22.483300 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb260030-3f88-466a-bb42-f1c777782154 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:22.490796 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81511746-d592-4207-90d3-17e0b874c082 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c2519ed2e747e78a2ca91c3625a20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:22.491523 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81511746-d592-4207-90d3-17e0b874c082 service placement] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:22.491839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81511746-d592-4207-90d3-17e0b874c082 service placement] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:22.492171 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81511746-d592-4207-90d3-17e0b874c082 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:22.499877 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb260030-3f88-466a-bb42-f1c777782154 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:22.500185 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-81511746-d592-4207-90d3-17e0b874c082 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:22.510728 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a64ee9-bd16-43ab-b004-221d616749e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:22.511862 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a64ee9-bd16-43ab-b004-221d616749e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:22.512239 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a64ee9-bd16-43ab-b004-221d616749e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:22.512613 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a64ee9-bd16-43ab-b004-221d616749e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:22.523339 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a64ee9-bd16-43ab-b004-221d616749e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:22.523831 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81511746-d592-4207-90d3-17e0b874c082 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:22.525034 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a64ee9-bd16-43ab-b004-221d616749e9 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:22.527694 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81511746-d592-4207-90d3-17e0b874c082 service placement] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:22.539881 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 603/1208] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:22:22 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:22:22.542558 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 606/1209] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:22:22 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:22:31.971592 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f8708-f5be-41e5-89f1-a8ff4544d8d5 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:31.972242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f8708-f5be-41e5-89f1-a8ff4544d8d5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:31.972242 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f8708-f5be-41e5-89f1-a8ff4544d8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:31.992761 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-468f8708-f5be-41e5-89f1-a8ff4544d8d5 None None] MFA Rules not processed for user `2562343e356e47fc86503e2b9cfa0269`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:31.993975 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-468f8708-f5be-41e5-89f1-a8ff4544d8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:32.001507 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 604/1210] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Aug 23 16:22:31 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:22:32.014393 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81511746-d592-4207-90d3-17e0b874c082 service placement] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:32.024875 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81511746-d592-4207-90d3-17e0b874c082 service placement] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:32.029094 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91811a-fb34-4452-a3a2-5032c42d073c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:32.029730 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91811a-fb34-4452-a3a2-5032c42d073c service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:32.030045 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91811a-fb34-4452-a3a2-5032c42d073c service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:32.030310 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91811a-fb34-4452-a3a2-5032c42d073c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:32.037462 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91811a-fb34-4452-a3a2-5032c42d073c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:32.038946 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91811a-fb34-4452-a3a2-5032c42d073c service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:32.050475 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 607/1211] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:22:32 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:22:32.773949 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec35b23-c7e7-43df-a9ef-348060372aa2 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:32.774280 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec35b23-c7e7-43df-a9ef-348060372aa2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:32.774855 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec35b23-c7e7-43df-a9ef-348060372aa2 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:32.776450 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 605/1212] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 23 16:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:22:32.807790 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6f46-5c1f-415f-971e-4a4059ecf5ae None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:32.808084 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6f46-5c1f-415f-971e-4a4059ecf5ae None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:32.808486 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6f46-5c1f-415f-971e-4a4059ecf5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:32.837811 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-a23e6f46-5c1f-415f-971e-4a4059ecf5ae None None] MFA Rules not processed for user `9c6749b0664141529ce43b78fbc836ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:32.839057 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-a23e6f46-5c1f-415f-971e-4a4059ecf5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:32.847915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 608/1213] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 23 16:22:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:22:32.878168 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec35b23-c7e7-43df-a9ef-348060372aa2 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:32.903001 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec35b23-c7e7-43df-a9ef-348060372aa2 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:32.924020 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc74945-bf47-4587-8b62-2cecee9c7a30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:32.924767 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74945-bf47-4587-8b62-2cecee9c7a30 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:32.925355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74945-bf47-4587-8b62-2cecee9c7a30 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:32.925625 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74945-bf47-4587-8b62-2cecee9c7a30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:32.934927 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc74945-bf47-4587-8b62-2cecee9c7a30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:32.937030 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc74945-bf47-4587-8b62-2cecee9c7a30 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:32.948684 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 606/1214] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:22:32 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:22:38.772293 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da5718-a66c-4926-8d33-1496c074a199 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:38.773069 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da5718-a66c-4926-8d33-1496c074a199 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:38.773069 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da5718-a66c-4926-8d33-1496c074a199 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:38.774424 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 609/1215] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 23 16:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:22:38.785799 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e10027-e0df-43cb-b1bf-e64e82df276b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:38.786398 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e10027-e0df-43cb-b1bf-e64e82df276b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:38.786398 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e10027-e0df-43cb-b1bf-e64e82df276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:38.809292 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-d2e10027-e0df-43cb-b1bf-e64e82df276b None None] MFA Rules not processed for user `9c6749b0664141529ce43b78fbc836ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:38.810554 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-d2e10027-e0df-43cb-b1bf-e64e82df276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:38.819940 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 607/1216] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 23 16:22:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:22:38.835364 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da5718-a66c-4926-8d33-1496c074a199 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:38.849665 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da5718-a66c-4926-8d33-1496c074a199 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:38.855599 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d45adf-279d-4a97-8477-8e1e3ce3f7e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:38.856195 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d45adf-279d-4a97-8477-8e1e3ce3f7e1 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:38.856473 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d45adf-279d-4a97-8477-8e1e3ce3f7e1 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:38.856734 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d45adf-279d-4a97-8477-8e1e3ce3f7e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:38.865903 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d45adf-279d-4a97-8477-8e1e3ce3f7e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:38.867829 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d45adf-279d-4a97-8477-8e1e3ce3f7e1 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:38.877455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 610/1217] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:22:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:22:48.804192 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=50 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:22:48.873491 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=88 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:22:50.713668 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e10027-e0df-43cb-b1bf-e64e82df276b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:50.723471 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e10027-e0df-43cb-b1bf-e64e82df276b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:50.727550 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa41522-368c-4721-b2a8-0374611860e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:50.728376 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa41522-368c-4721-b2a8-0374611860e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:50.728652 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa41522-368c-4721-b2a8-0374611860e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:50.728916 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa41522-368c-4721-b2a8-0374611860e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:50.738797 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa41522-368c-4721-b2a8-0374611860e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:50.740275 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa41522-368c-4721-b2a8-0374611860e1 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:50.750071 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 608/1218] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:22:50 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:23:00.745715 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=6 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:23:13.115157 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b5c86-ac3b-4fd3-83b2-b69a0c2f387a None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:13.116133 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b5c86-ac3b-4fd3-83b2-b69a0c2f387a None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:13.116133 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b5c86-ac3b-4fd3-83b2-b69a0c2f387a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:13.138523 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-d79b5c86-ac3b-4fd3-83b2-b69a0c2f387a None None] MFA Rules not processed for user `c51c8adbc0124a339d136fcf94e11736`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:23:13.139717 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-d79b5c86-ac3b-4fd3-83b2-b69a0c2f387a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:13.148166 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 611/1219] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:23:13 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:23:13.705476 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8db7-07f3-49bc-9afa-5e3528c8cc16 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:13.706098 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8db7-07f3-49bc-9afa-5e3528c8cc16 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:13.706098 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8db7-07f3-49bc-9afa-5e3528c8cc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:13.727151 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-945f8db7-07f3-49bc-9afa-5e3528c8cc16 None None] MFA Rules not processed for user `2562343e356e47fc86503e2b9cfa0269`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:23:13.728385 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-945f8db7-07f3-49bc-9afa-5e3528c8cc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:13.735584 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 609/1220] 10.222.0.47 () {58 vars in 1009 bytes} [Tue Aug 23 16:23:13 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:23:13.747420 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b5c86-ac3b-4fd3-83b2-b69a0c2f387a None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:23:13.758926 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b5c86-ac3b-4fd3-83b2-b69a0c2f387a None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:23:13.763361 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4909d1-5935-4f14-8160-c02004c87ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:23:13.763963 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4909d1-5935-4f14-8160-c02004c87ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:13.764237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4909d1-5935-4f14-8160-c02004c87ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:13.764498 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4909d1-5935-4f14-8160-c02004c87ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:13.772043 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4909d1-5935-4f14-8160-c02004c87ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:23:13.773477 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4909d1-5935-4f14-8160-c02004c87ab9 service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:23:13.781782 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 612/1221] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:23:13 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:23:23.722517 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:23:23.777974 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=9 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:23:39.072449 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5b77d-1745-4bff-8f6e-362c03670652 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:39.072992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5b77d-1745-4bff-8f6e-362c03670652 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:39.072992 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5b77d-1745-4bff-8f6e-362c03670652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:39.093982 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-26d5b77d-1745-4bff-8f6e-362c03670652 None None] MFA Rules not processed for user `c51c8adbc0124a339d136fcf94e11736`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:23:39.095297 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-26d5b77d-1745-4bff-8f6e-362c03670652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:39.103405 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 610/1222] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:23:39 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:23:49.088200 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:23:52.966023 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e7969-c52f-4cdf-919d-ac5c05d2aefd None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:52.966537 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e7969-c52f-4cdf-919d-ac5c05d2aefd None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:52.966537 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e7969-c52f-4cdf-919d-ac5c05d2aefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:52.986880 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-905e7969-c52f-4cdf-919d-ac5c05d2aefd None None] MFA Rules not processed for user `c51c8adbc0124a339d136fcf94e11736`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:23:52.988104 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-905e7969-c52f-4cdf-919d-ac5c05d2aefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:52.998140 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 613/1223] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:23:52 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:24:02.981165 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=3 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:50.647991 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420bf4c-f241-402f-a366-aa90db7e5857 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.648535 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420bf4c-f241-402f-a366-aa90db7e5857 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.648535 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420bf4c-f241-402f-a366-aa90db7e5857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.673022 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-f420bf4c-f241-402f-a366-aa90db7e5857 None None] MFA Rules not processed for user `c51c8adbc0124a339d136fcf94e11736`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:50.675835 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-f420bf4c-f241-402f-a366-aa90db7e5857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:50.688475 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 611/1224] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:24:50 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:25:00.664309 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:02.512865 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e7969-c52f-4cdf-919d-ac5c05d2aefd None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:02.535275 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e7969-c52f-4cdf-919d-ac5c05d2aefd None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:02.539067 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f86db-d6e7-4aa0-a3da-57017bbf9dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:02.539667 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f86db-d6e7-4aa0-a3da-57017bbf9dbf service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:02.539941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f86db-d6e7-4aa0-a3da-57017bbf9dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:02.540212 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f86db-d6e7-4aa0-a3da-57017bbf9dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:02.549490 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f86db-d6e7-4aa0-a3da-57017bbf9dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:02.551094 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f86db-d6e7-4aa0-a3da-57017bbf9dbf service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:02.560844 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 614/1225] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:25:02 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:25:12.556491 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=10 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:25.689722 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c841ce-5988-4667-b0cb-462c30e7bca7 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:25.690215 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c841ce-5988-4667-b0cb-462c30e7bca7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:25.690379 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c841ce-5988-4667-b0cb-462c30e7bca7 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:25.691727 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 612/1226] 10.222.0.47 () {54 vars in 961 bytes} [Tue Aug 23 16:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:25.696940 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc026b-da25-46ae-b384-25d1f7bfd272 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:25.697394 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc026b-da25-46ae-b384-25d1f7bfd272 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:25.697493 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc026b-da25-46ae-b384-25d1f7bfd272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:25.764982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-69fc026b-da25-46ae-b384-25d1f7bfd272 None None] MFA Rules not processed for user `19c2519ed2e747e78a2ca91c3625a20d`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:25.766138 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-69fc026b-da25-46ae-b384-25d1f7bfd272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:25.785785 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 615/1227] 10.222.0.47 () {58 vars in 1058 bytes} [Tue Aug 23 16:26:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:25.797639 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c841ce-5988-4667-b0cb-462c30e7bca7 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:25.818579 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c841ce-5988-4667-b0cb-462c30e7bca7 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:25.824871 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8671fe6-9634-4274-9a73-e94e2629c4b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c2519ed2e747e78a2ca91c3625a20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:25.825474 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8671fe6-9634-4274-9a73-e94e2629c4b8 service placement] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:25.825748 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8671fe6-9634-4274-9a73-e94e2629c4b8 service placement] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:25.826022 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8671fe6-9634-4274-9a73-e94e2629c4b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:25.835627 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8671fe6-9634-4274-9a73-e94e2629c4b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:25.837215 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8671fe6-9634-4274-9a73-e94e2629c4b8 service placement] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:25.847855 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 613/1228] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:25 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:27.731137 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cf9bd-2ea8-4a48-9cf8-ee4f269670a5 None None] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:27.731590 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cf9bd-2ea8-4a48-9cf8-ee4f269670a5 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:27.731679 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cf9bd-2ea8-4a48-9cf8-ee4f269670a5 None None] PATH_INFO: `/` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:27.733269 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 616/1229] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 23 16:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:27.738158 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacf9fe-d308-4a34-ad51-33f71a37a010 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:27.738598 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacf9fe-d308-4a34-ad51-33f71a37a010 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:27.738705 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacf9fe-d308-4a34-ad51-33f71a37a010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:27.782596 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-ebacf9fe-d308-4a34-ad51-33f71a37a010 None None] MFA Rules not processed for user `9c6749b0664141529ce43b78fbc836ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:27.783856 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-ebacf9fe-d308-4a34-ad51-33f71a37a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:27.803624 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 614/1230] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 23 16:26:27 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:27.819848 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cf9bd-2ea8-4a48-9cf8-ee4f269670a5 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:27.833863 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cf9bd-2ea8-4a48-9cf8-ee4f269670a5 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:27.839609 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1e3b8-52a5-4ae7-bc1c-43647d990c73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:27.840455 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1e3b8-52a5-4ae7-bc1c-43647d990c73 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:27.840933 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1e3b8-52a5-4ae7-bc1c-43647d990c73 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:27.841264 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1e3b8-52a5-4ae7-bc1c-43647d990c73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:27.851290 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1e3b8-52a5-4ae7-bc1c-43647d990c73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:27.852989 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1e3b8-52a5-4ae7-bc1c-43647d990c73 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:27.864070 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 617/1231] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:27 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:37.800318 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=19 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:37.859596 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=28 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:41.304099 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8589710-991f-4de2-a2d5-3b10048d2db2 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:41.304650 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8589710-991f-4de2-a2d5-3b10048d2db2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:41.304743 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8589710-991f-4de2-a2d5-3b10048d2db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:41.325390 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-d8589710-991f-4de2-a2d5-3b10048d2db2 None None] MFA Rules not processed for user `0de1ce496a7547f5844660372c9a5b91`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:41.326631 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-d8589710-991f-4de2-a2d5-3b10048d2db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:41.334957 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 615/1232] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:26:41 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:51.320034 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:17.916239 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1e3b8-52a5-4ae7-bc1c-43647d990c73 service nova] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:17.927682 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1e3b8-52a5-4ae7-bc1c-43647d990c73 service nova] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:17.933675 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83a00-169e-4d76-80dc-d8de4ae345b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:17.934328 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83a00-169e-4d76-80dc-d8de4ae345b9 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:17.934603 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83a00-169e-4d76-80dc-d8de4ae345b9 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:17.934901 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83a00-169e-4d76-80dc-d8de4ae345b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:17.943171 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c83a00-169e-4d76-80dc-d8de4ae345b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:17.944839 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c83a00-169e-4d76-80dc-d8de4ae345b9 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:17.954020 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 618/1233] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:17 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:22.835469 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef8bb-d681-48ca-b5d6-62df86f7679a None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:22.836456 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef8bb-d681-48ca-b5d6-62df86f7679a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:22.836456 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef8bb-d681-48ca-b5d6-62df86f7679a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:22.856813 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-348ef8bb-d681-48ca-b5d6-62df86f7679a None None] MFA Rules not processed for user `c51c8adbc0124a339d136fcf94e11736`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:22.858045 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-348ef8bb-d681-48ca-b5d6-62df86f7679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:22.866502 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 616/1234] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:27:22 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:22.906163 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83a00-169e-4d76-80dc-d8de4ae345b9 service nova] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:22.975786 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83a00-169e-4d76-80dc-d8de4ae345b9 service nova] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:22.979574 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be06514-fee1-4706-a011-d3e48b25450f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2225825e32a488ea5bca33c00bb1b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:22.980183 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be06514-fee1-4706-a011-d3e48b25450f service cinder] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:22.980463 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be06514-fee1-4706-a011-d3e48b25450f service cinder] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:22.980733 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be06514-fee1-4706-a011-d3e48b25450f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:22.990702 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be06514-fee1-4706-a011-d3e48b25450f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:22.992174 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be06514-fee1-4706-a011-d3e48b25450f service cinder] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:23.002634 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 619/1235] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:22 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:23.770438 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ef8bb-d681-48ca-b5d6-62df86f7679a None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:23.777335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be06514-fee1-4706-a011-d3e48b25450f service cinder] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:23.783148 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ef8bb-d681-48ca-b5d6-62df86f7679a None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:23.786483 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be06514-fee1-4706-a011-d3e48b25450f service cinder] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:23.788750 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a57200-2eb3-47da-95e2-4667bd8bad1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c2519ed2e747e78a2ca91c3625a20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:23.789360 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a57200-2eb3-47da-95e2-4667bd8bad1a service placement] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:23.789639 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a57200-2eb3-47da-95e2-4667bd8bad1a service placement] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:23.789909 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a57200-2eb3-47da-95e2-4667bd8bad1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:23.790614 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60588176-69e8-419c-bace-53cde2833a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:23.791274 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60588176-69e8-419c-bace-53cde2833a15 service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:23.791637 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60588176-69e8-419c-bace-53cde2833a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:23.791966 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60588176-69e8-419c-bace-53cde2833a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:23.798714 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a57200-2eb3-47da-95e2-4667bd8bad1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:23.800279 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a57200-2eb3-47da-95e2-4667bd8bad1a service placement] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:23.802522 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60588176-69e8-419c-bace-53cde2833a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:23.804005 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60588176-69e8-419c-bace-53cde2833a15 service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:23.810130 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 617/1236] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:23 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:23.814334 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 620/1237] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:23 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:27:32.578864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a57200-2eb3-47da-95e2-4667bd8bad1a service placement] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:32.588802 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a57200-2eb3-47da-95e2-4667bd8bad1a service placement] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:32.593355 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca16608-5feb-45b5-bc48-f286378c07ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:32.593943 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca16608-5feb-45b5-bc48-f286378c07ab service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:32.594397 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca16608-5feb-45b5-bc48-f286378c07ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:32.594663 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca16608-5feb-45b5-bc48-f286378c07ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:32.602301 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca16608-5feb-45b5-bc48-f286378c07ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:32.603781 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca16608-5feb-45b5-bc48-f286378c07ab service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:32.611564 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 618/1238] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:32 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:33.809852 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=42 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:35.496602 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60588176-69e8-419c-bace-53cde2833a15 service neutron] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:35.508184 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60588176-69e8-419c-bace-53cde2833a15 service neutron] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:35.514780 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02ad3c-9935-419d-8bc7-f707b4206d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:35.515398 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ad3c-9935-419d-8bc7-f707b4206d1b service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:35.515686 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ad3c-9935-419d-8bc7-f707b4206d1b service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:35.515955 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ad3c-9935-419d-8bc7-f707b4206d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:35.525586 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02ad3c-9935-419d-8bc7-f707b4206d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:35.527244 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02ad3c-9935-419d-8bc7-f707b4206d1b service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:35.537801 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 621/1239] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:35 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:42.608466 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=15 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:45.532696 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=6 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:27.970023 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca16608-5feb-45b5-bc48-f286378c07ab service neutron] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:27.991956 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca16608-5feb-45b5-bc48-f286378c07ab service neutron] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:27.997661 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7578d-01b9-46e7-8ee5-9166c64c25e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:27.998270 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7578d-01b9-46e7-8ee5-9166c64c25e5 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:27.998547 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7578d-01b9-46e7-8ee5-9166c64c25e5 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:27.998817 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7578d-01b9-46e7-8ee5-9166c64c25e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:28.008353 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7578d-01b9-46e7-8ee5-9166c64c25e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:28.009953 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7578d-01b9-46e7-8ee5-9166c64c25e5 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:28.021825 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 619/1240] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:27 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:29.461589 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02ad3c-9935-419d-8bc7-f707b4206d1b service nova] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:29.472018 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02ad3c-9935-419d-8bc7-f707b4206d1b service nova] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:29.478531 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88821c-f921-4f1a-bf49-0fe1fd9d8495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:29.478531 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88821c-f921-4f1a-bf49-0fe1fd9d8495 service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:29.478531 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88821c-f921-4f1a-bf49-0fe1fd9d8495 service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:29.478531 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88821c-f921-4f1a-bf49-0fe1fd9d8495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:29.563558 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88821c-f921-4f1a-bf49-0fe1fd9d8495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:29.564943 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88821c-f921-4f1a-bf49-0fe1fd9d8495 service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:29.584440 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 622/1241] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:33.901266 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7a927-043a-4f2d-8e75-f02af41b948d None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:33.902219 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7a927-043a-4f2d-8e75-f02af41b948d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:33.902490 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7a927-043a-4f2d-8e75-f02af41b948d None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:33.903857 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 620/1242] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 23 16:28:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:33.942172 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185dee9-a256-43ee-8af6-32a878386f1e None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:33.942927 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185dee9-a256-43ee-8af6-32a878386f1e None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:33.942927 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185dee9-a256-43ee-8af6-32a878386f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:33.977151 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-6185dee9-a256-43ee-8af6-32a878386f1e None None] MFA Rules not processed for user `19c2519ed2e747e78a2ca91c3625a20d`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:33.978944 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-6185dee9-a256-43ee-8af6-32a878386f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:33.990961 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 623/1243] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 23 16:28:33 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:34.002380 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7a927-043a-4f2d-8e75-f02af41b948d None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:34.016791 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7a927-043a-4f2d-8e75-f02af41b948d None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:34.022964 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf8738-d770-466d-aa5e-a963b94193d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c2519ed2e747e78a2ca91c3625a20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:34.023575 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf8738-d770-466d-aa5e-a963b94193d8 service placement] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:34.023850 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf8738-d770-466d-aa5e-a963b94193d8 service placement] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:34.024117 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf8738-d770-466d-aa5e-a963b94193d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:34.033555 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf8738-d770-466d-aa5e-a963b94193d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:34.035228 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf8738-d770-466d-aa5e-a963b94193d8 service placement] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:34.046351 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 621/1244] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:34 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:37.339723 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185dee9-a256-43ee-8af6-32a878386f1e None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:37.356857 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185dee9-a256-43ee-8af6-32a878386f1e None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:37.364496 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:37.365186 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:37.365469 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:37.366221 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] PATH_INFO: `/v3/users/0de1ce496a7547f5844660372c9a5b91` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:37.367066 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de1ce496a7547f5844660372c9a5b91)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:37.369061 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:37.434971 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de1ce496a7547f5844660372c9a5b91'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:37.455696 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de1ce496a7547f5844660372c9a5b91'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:37.457288 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de1ce496a7547f5844660372c9a5b91'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:37.458418 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de1ce496a7547f5844660372c9a5b91'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:37.467140 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de1ce496a7547f5844660372c9a5b91'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:37.481159 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 624/1245] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 23 16:28:37 2022] DELETE /identity/v3/users/0de1ce496a7547f5844660372c9a5b91 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:28:37.688422 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf8738-d770-466d-aa5e-a963b94193d8 service placement] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:37.705324 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf8738-d770-466d-aa5e-a963b94193d8 service placement] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:37.779482 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:37.782696 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:37.783196 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:37.783463 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] PATH_INFO: `/v3/projects/3686e57cb5b047f1add0dccdfaa8174b` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:37.787567 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3686e57cb5b047f1add0dccdfaa8174b)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:37.789908 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:37.851617 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3686e57cb5b047f1add0dccdfaa8174b', 'request_id': 'req-6003e197-222d-4d84-bada-d2e7a7a8c150'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:37.860880 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3686e57cb5b047f1add0dccdfaa8174b', 'request_id': 'req-6003e197-222d-4d84-bada-d2e7a7a8c150'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:37.868134 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3686e57cb5b047f1add0dccdfaa8174b', 'request_id': 'req-6003e197-222d-4d84-bada-d2e7a7a8c150'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:37.881838 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] The token cache is being invalidate because project 3686e57cb5b047f1add0dccdfaa8174b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:28:37.882388 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:37.883556 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:37.885110 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 622/1246] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 23 16:28:37 2022] DELETE /identity/v3/projects/3686e57cb5b047f1add0dccdfaa8174b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:28:37.889520 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:37.891207 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:37.907574 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080c325-7b7a-4332-8350-64176c7ab84a admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:37.968692 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:37.983761 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a6091-3605-4efb-984f-0e7c7547d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:37.984405 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6091-3605-4efb-984f-0e7c7547d5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:37.984704 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6091-3605-4efb-984f-0e7c7547d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:37.984982 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6091-3605-4efb-984f-0e7c7547d5f0 admin admin] PATH_INFO: `/v3/users/7689a631b7a3434583c5bed51eb9df18` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:37.986237 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a6091-3605-4efb-984f-0e7c7547d5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7689a631b7a3434583c5bed51eb9df18)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:37.988189 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a6091-3605-4efb-984f-0e7c7547d5f0 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:38.051150 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-1d7a6091-3605-4efb-984f-0e7c7547d5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7689a631b7a3434583c5bed51eb9df18'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:38.064883 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-1d7a6091-3605-4efb-984f-0e7c7547d5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7689a631b7a3434583c5bed51eb9df18'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:38.065686 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-1d7a6091-3605-4efb-984f-0e7c7547d5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7689a631b7a3434583c5bed51eb9df18'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:38.066355 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-1d7a6091-3605-4efb-984f-0e7c7547d5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7689a631b7a3434583c5bed51eb9df18'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:38.073890 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-1d7a6091-3605-4efb-984f-0e7c7547d5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7689a631b7a3434583c5bed51eb9df18'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:38.088598 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 625/1247] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 23 16:28:37 2022] DELETE /identity/v3/users/7689a631b7a3434583c5bed51eb9df18 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:28:38.315712 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:38.317612 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:38.337543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003e197-222d-4d84-bada-d2e7a7a8c150 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:38.421170 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:38.422121 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:38.422577 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:38.422972 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] PATH_INFO: `/v3/projects/ae4ccfc0294447ebb3d68dd0b971b5b4` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:38.424814 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4ccfc0294447ebb3d68dd0b971b5b4)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:38.426801 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:38.434311 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:38.486593 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4ccfc0294447ebb3d68dd0b971b5b4', 'request_id': 'req-b9010421-3507-4b47-b5e8-2437e1a92ddc'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:38.495407 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4ccfc0294447ebb3d68dd0b971b5b4', 'request_id': 'req-b9010421-3507-4b47-b5e8-2437e1a92ddc'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:38.506901 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4ccfc0294447ebb3d68dd0b971b5b4', 'request_id': 'req-b9010421-3507-4b47-b5e8-2437e1a92ddc'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:38.527161 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] The token cache is being invalidate because project ae4ccfc0294447ebb3d68dd0b971b5b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:28:38.527729 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:38.528597 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:28:38.530467 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 623/1248] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 23 16:28:38 2022] DELETE /identity/v3/projects/ae4ccfc0294447ebb3d68dd0b971b5b4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:28:48.084959 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:48.516077 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:28.859645 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bea17-aa86-40c4-91d6-dcc3661b05a3 None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:28.860236 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bea17-aa86-40c4-91d6-dcc3661b05a3 None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:28.860236 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bea17-aa86-40c4-91d6-dcc3661b05a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:28.886650 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-5f7bea17-aa86-40c4-91d6-dcc3661b05a3 None None] MFA Rules not processed for user `c51c8adbc0124a339d136fcf94e11736`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:29:28.888335 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-5f7bea17-aa86-40c4-91d6-dcc3661b05a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:28.947584 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 626/1249] 10.222.0.47 () {58 vars in 958 bytes} [Tue Aug 23 16:29:28 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:29:29.299958 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:29.303216 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:29.374124 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9010421-3507-4b47-b5e8-2437e1a92ddc admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:29.378183 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e069144-0c1d-45c3-94d3-055c6e7e0457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:29.378795 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e069144-0c1d-45c3-94d3-055c6e7e0457 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:29.379068 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e069144-0c1d-45c3-94d3-055c6e7e0457 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:29.379336 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e069144-0c1d-45c3-94d3-055c6e7e0457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:29.381160 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-5e069144-0c1d-45c3-94d3-055c6e7e0457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:29.391209 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e069144-0c1d-45c3-94d3-055c6e7e0457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:29.392626 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e069144-0c1d-45c3-94d3-055c6e7e0457 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:29.401169 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 624/1250] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:29:29 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:29:38.927120 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bea17-aa86-40c4-91d6-dcc3661b05a3 None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:38.928633 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-5f7bea17-aa86-40c4-91d6-dcc3661b05a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:39.016392 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bea17-aa86-40c4-91d6-dcc3661b05a3 None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:39.021464 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f137408-cd2f-4a26-b0bc-06474b741527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6749b0664141529ce43b78fbc836ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:39.022074 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f137408-cd2f-4a26-b0bc-06474b741527 service nova] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:39.022368 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f137408-cd2f-4a26-b0bc-06474b741527 service nova] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:39.022630 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f137408-cd2f-4a26-b0bc-06474b741527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:39.024536 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-1f137408-cd2f-4a26-b0bc-06474b741527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:39.038720 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f137408-cd2f-4a26-b0bc-06474b741527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:39.040797 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f137408-cd2f-4a26-b0bc-06474b741527 service nova] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:39.051393 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 627/1251] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:29:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:29:39.397415 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=26 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:49.046789 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=57 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:26.162646 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e069144-0c1d-45c3-94d3-055c6e7e0457 service neutron] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:31:26.164288 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-5e069144-0c1d-45c3-94d3-055c6e7e0457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:31:26.293291 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e069144-0c1d-45c3-94d3-055c6e7e0457 service neutron] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:31:26.299016 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3692e0-097c-4289-9384-b24db248160c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c2519ed2e747e78a2ca91c3625a20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:31:26.299634 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3692e0-097c-4289-9384-b24db248160c service placement] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:26.299909 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3692e0-097c-4289-9384-b24db248160c service placement] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:26.300180 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3692e0-097c-4289-9384-b24db248160c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:26.302128 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-4b3692e0-097c-4289-9384-b24db248160c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:31:26.314900 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3692e0-097c-4289-9384-b24db248160c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:31:26.316597 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3692e0-097c-4289-9384-b24db248160c service placement] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:31:26.326720 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 625/1252] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:31:26 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:31:36.322827 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=54 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:07.807705 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f137408-cd2f-4a26-b0bc-06474b741527 service nova] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:07.809166 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-1f137408-cd2f-4a26-b0bc-06474b741527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:07.868488 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f137408-cd2f-4a26-b0bc-06474b741527 service nova] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:07.872876 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d50c5-109d-4816-8441-0bad8881c7d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2562343e356e47fc86503e2b9cfa0269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:07.873492 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d50c5-109d-4816-8441-0bad8881c7d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:07.873811 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d50c5-109d-4816-8441-0bad8881c7d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:07.874110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d50c5-109d-4816-8441-0bad8881c7d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:07.876010 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-e13d50c5-109d-4816-8441-0bad8881c7d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:07.968900 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d50c5-109d-4816-8441-0bad8881c7d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:07.970358 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d50c5-109d-4816-8441-0bad8881c7d4 service neutron] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:07.980447 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 628/1253] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:13.950887 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fc490-faa9-4feb-a1a1-beedca2bfe42 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:13.951881 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fc490-faa9-4feb-a1a1-beedca2bfe42 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:13.952157 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fc490-faa9-4feb-a1a1-beedca2bfe42 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:13.954016 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 626/1254] 10.222.0.47 () {54 vars in 921 bytes} [Tue Aug 23 16:32:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:32:13.967554 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f8654-5ffa-4cb8-b339-ebe12c98928e None None] REQUEST_METHOD: `POST` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:13.968119 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f8654-5ffa-4cb8-b339-ebe12c98928e None None] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:13.968119 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f8654-5ffa-4cb8-b339-ebe12c98928e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:14.000682 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.auth.core [None req-4b5f8654-5ffa-4cb8-b339-ebe12c98928e None None] MFA Rules not processed for user `19c2519ed2e747e78a2ca91c3625a20d`. Rule list: `[]` (Enabled: `True`). {{(pid=88358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:32:14.002443 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-4b5f8654-5ffa-4cb8-b339-ebe12c98928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:14.015740 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 629/1255] 10.222.0.47 () {58 vars in 1018 bytes} [Tue Aug 23 16:32:13 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:32:14.029516 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fc490-faa9-4feb-a1a1-beedca2bfe42 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:14.031477 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-e06fc490-faa9-4feb-a1a1-beedca2bfe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:14.037794 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f8654-5ffa-4cb8-b339-ebe12c98928e None None] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:14.039363 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-4b5f8654-5ffa-4cb8-b339-ebe12c98928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:14.051448 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fc490-faa9-4feb-a1a1-beedca2bfe42 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:14.053756 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f8654-5ffa-4cb8-b339-ebe12c98928e None None] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:14.056681 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5279ae-260d-41df-bbc1-c44d5f7faff5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c2519ed2e747e78a2ca91c3625a20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:14.057354 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5279ae-260d-41df-bbc1-c44d5f7faff5 service placement] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:14.057696 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5279ae-260d-41df-bbc1-c44d5f7faff5 service placement] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:14.057961 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5279ae-260d-41df-bbc1-c44d5f7faff5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:14.058470 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:14.059114 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:14.059410 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:14.059677 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] PATH_INFO: `/v3/users/c51c8adbc0124a339d136fcf94e11736` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:14.066604 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5279ae-260d-41df-bbc1-c44d5f7faff5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:14.068190 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5279ae-260d-41df-bbc1-c44d5f7faff5 service placement] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:14.073648 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51c8adbc0124a339d136fcf94e11736)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:14.075915 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:14.078581 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 627/1256] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:14 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:14.123976 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51c8adbc0124a339d136fcf94e11736'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.134725 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:14.136220 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51c8adbc0124a339d136fcf94e11736'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.137073 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51c8adbc0124a339d136fcf94e11736'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.137920 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51c8adbc0124a339d136fcf94e11736'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.146714 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51c8adbc0124a339d136fcf94e11736'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.160634 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 630/1257] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 23 16:32:14 2022] DELETE /identity/v3/users/c51c8adbc0124a339d136fcf94e11736 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:32:14.351459 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5279ae-260d-41df-bbc1-c44d5f7faff5 service placement] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:14.364073 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5279ae-260d-41df-bbc1-c44d5f7faff5 service placement] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:14.428146 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:14.428772 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:14.429045 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:14.429314 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] PATH_INFO: `/v3/projects/fba3a5b99c054dc4b27f7fe5b0958036` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:14.439728 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba3a5b99c054dc4b27f7fe5b0958036)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:14.441661 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:14.489304 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba3a5b99c054dc4b27f7fe5b0958036', 'request_id': 'req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.497543 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba3a5b99c054dc4b27f7fe5b0958036', 'request_id': 'req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.507372 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba3a5b99c054dc4b27f7fe5b0958036', 'request_id': 'req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.520864 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] The token cache is being invalidate because project fba3a5b99c054dc4b27f7fe5b0958036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:32:14.521083 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.521851 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.523529 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 628/1258] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 23 16:32:14 2022] DELETE /identity/v3/projects/fba3a5b99c054dc4b27f7fe5b0958036 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:32:14.527737 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:14.529389 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:14.543652 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573f817-a3d8-4248-9ae0-7ce0816f7697 admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:14.599846 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:14.600468 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:14.600741 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:14.601005 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] PATH_INFO: `/v3/users/cd3eb43104f047cfbb467bd02033bd0c` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:14.614712 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3eb43104f047cfbb467bd02033bd0c)` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:14.616742 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:14.671084 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3eb43104f047cfbb467bd02033bd0c'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.683300 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3eb43104f047cfbb467bd02033bd0c'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.683965 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3eb43104f047cfbb467bd02033bd0c'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.684604 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3eb43104f047cfbb467bd02033bd0c'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.691408 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.notifications [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3eb43104f047cfbb467bd02033bd0c'} {{(pid=88358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:14.705582 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 631/1259] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 23 16:32:14 2022] DELETE /identity/v3/users/cd3eb43104f047cfbb467bd02033bd0c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:32:14.886366 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:14.888586 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:14.907743 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b8c30-56b4-4c92-9e24-cfa677d45bbe admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:14.983225 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e0568-d189-4af0-b2e3-50f728c48b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e029965b87334204be7b0f6baa7febea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '295f022ed51d4bed9be5939f17b6ff6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:14.983928 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e0568-d189-4af0-b2e3-50f728c48b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:14.984114 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e0568-d189-4af0-b2e3-50f728c48b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:14.984462 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e0568-d189-4af0-b2e3-50f728c48b49 admin admin] PATH_INFO: `/v3/projects/796119e8036540acabd74d427b7b19c4` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:15.001582 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e0568-d189-4af0-b2e3-50f728c48b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=796119e8036540acabd74d427b7b19c4)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:15.003842 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e0568-d189-4af0-b2e3-50f728c48b49 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:15.005199 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:15.056782 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-0e7e0568-d189-4af0-b2e3-50f728c48b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796119e8036540acabd74d427b7b19c4', 'request_id': 'req-0e7e0568-d189-4af0-b2e3-50f728c48b49'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:15.065163 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-0e7e0568-d189-4af0-b2e3-50f728c48b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796119e8036540acabd74d427b7b19c4', 'request_id': 'req-0e7e0568-d189-4af0-b2e3-50f728c48b49'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:15.071406 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-0e7e0568-d189-4af0-b2e3-50f728c48b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796119e8036540acabd74d427b7b19c4', 'request_id': 'req-0e7e0568-d189-4af0-b2e3-50f728c48b49'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:15.083060 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-0e7e0568-d189-4af0-b2e3-50f728c48b49 admin admin] The token cache is being invalidate because project 796119e8036540acabd74d427b7b19c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:32:15.083346 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-0e7e0568-d189-4af0-b2e3-50f728c48b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:15.084046 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-0e7e0568-d189-4af0-b2e3-50f728c48b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:32:15.085869 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 629/1260] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 23 16:32:14 2022] DELETE /identity/v3/projects/796119e8036540acabd74d427b7b19c4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:32:24.702430 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG dbcounter [-] [88358] Writing DB stats keystone:SELECT=65,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:25.080059 dv-osbrick-836056-3-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:40.674410 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] Authenticating user token {{(pid=88358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:40.676110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:40.776941 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4b22e-4cc4-4e33-ac2c-bb4c9ab7e06b admin admin] Validating token access rules against request {{(pid=88358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:40.862530 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b4945-1aca-4675-999e-4a1e0cac9a74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19c2519ed2e747e78a2ca91c3625a20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce23217f97fd4906afea681353330615', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:40.863137 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b4945-1aca-4675-999e-4a1e0cac9a74 service placement] REQUEST_METHOD: `GET` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:40.863406 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b4945-1aca-4675-999e-4a1e0cac9a74 service placement] SCRIPT_NAME: `/identity` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:40.863672 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b4945-1aca-4675-999e-4a1e0cac9a74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:40.865807 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.fernet_utils [None req-7f2b4945-1aca-4675-999e-4a1e0cac9a74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:40.877110 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b4945-1aca-4675-999e-4a1e0cac9a74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:40.878724 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b4945-1aca-4675-999e-4a1e0cac9a74 service placement] RBAC: Authorization granted {{(pid=88358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:40.891535 dv-osbrick-836056-3-ceph devstack@keystone.service[88358]: [pid: 88358|app: 0|req: 632/1261] 10.222.0.47 () {60 vars in 1365 bytes} [Tue Aug 23 16:36:40 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)